2024-09-12T21:40:33.454 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T21:40:33.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T21:40:33.559 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7902901' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8861 sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbYlzzASSsQQfsDr/xOQOkJ2Hnwxq1B+bKCoW++LkvNggM7WTHbQQJPDUQ6DLqj+ZjiGaTQCGjlK5kuQGbo2EM= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmqVRuhnvhBFgLsve5A1/1bVG0HywbH58EFKjI/67apoS0Nz3BGowuxAJxfRlQ+neqnx+vFLLtht7HJ7mhG8r0= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIqx+gvyzbTnXy3gykliS0At80Yk4yOle6IOl5w1lBdxOzBvLV/opwKd/9TDUUUKieYj3WKuuuAEiIDgQGF7ec0= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGG1JgXrVV2FDqTI9xm8uwpOusMtEe72ge7LWATOwWVwQL7ZQRYnu5IT71EMnIAaAASBAfPBEPYDueEo0ya9qcE= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T21:40:33.559 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa; will attempt to use it 2024-09-12T21:40:33.560 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa/tasks 2024-09-12T21:40:33.560 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T21:40:33.562 INFO:teuthology.task.internal:Checking packages... 2024-09-12T21:40:33.583 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '086c737fa75c22d521a3932c59b31c5e1d1c9ef4' 2024-09-12T21:40:33.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T21:40:33.584 INFO:teuthology.packaging:ref: None 2024-09-12T21:40:33.584 INFO:teuthology.packaging:tag: None 2024-09-12T21:40:33.584 INFO:teuthology.packaging:branch: squid 2024-09-12T21:40:33.584 INFO:teuthology.packaging:sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:40:33.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T21:40:33.813 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-12T21:40:33.816 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T21:40:33.823 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T21:40:33.823 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T21:40:33.863 INFO:teuthology.task.internal:Saving configuration 2024-09-12T21:40:33.876 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T21:40:33.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T21:40:33.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:35:14.279756', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbYlzzASSsQQfsDr/xOQOkJ2Hnwxq1B+bKCoW++LkvNggM7WTHbQQJPDUQ6DLqj+ZjiGaTQCGjlK5kuQGbo2EM='} 2024-09-12T21:40:33.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:35:14.276862', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmqVRuhnvhBFgLsve5A1/1bVG0HywbH58EFKjI/67apoS0Nz3BGowuxAJxfRlQ+neqnx+vFLLtht7HJ7mhG8r0='} 2024-09-12T21:40:33.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:35:14.275181', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIqx+gvyzbTnXy3gykliS0At80Yk4yOle6IOl5w1lBdxOzBvLV/opwKd/9TDUUUKieYj3WKuuuAEiIDgQGF7ec0='} 2024-09-12T21:40:33.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:35:14.278322', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGG1JgXrVV2FDqTI9xm8uwpOusMtEe72ge7LWATOwWVwQL7ZQRYnu5IT71EMnIAaAASBAfPBEPYDueEo0ya9qcE='} 2024-09-12T21:40:33.987 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T21:40:33.994 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T21:40:33.994 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['osd.0'] 2024-09-12T21:40:33.994 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['osd.1'] 2024-09-12T21:40:33.994 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['osd.2'] 2024-09-12T21:40:33.994 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T21:40:34.138 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff2a4832e0>, signals=[15]) 2024-09-12T21:40:34.138 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T21:40:34.144 INFO:teuthology.task.internal:Opening connections... 2024-09-12T21:40:34.144 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-12T21:40:34.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:40:34.221 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:40:34.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:40:34.295 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T21:40:34.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:40:34.378 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:40:34.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:40:34.453 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T21:40:34.461 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-12T21:40:34.479 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-12T21:40:34.480 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-12T21:40:34.537 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:40:34.538 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:40:34.539 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:40:34.539 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:40:34.539 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-12T21:40:34.557 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-12T21:40:34.575 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-12T21:40:34.576 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-12T21:40:34.634 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-12T21:40:34.634 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-12T21:40:34.634 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-12T21:40:34.634 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:40:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:40:34.636 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-12T21:40:34.657 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-12T21:40:34.676 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-12T21:40:34.677 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-12T21:40:34.736 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-09-12T21:40:34.736 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-09-12T21:40:34.736 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:40:34.737 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:40:34.738 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-12T21:40:34.757 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-12T21:40:34.776 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-12T21:40:34.776 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-12T21:40:34.834 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:40:34.835 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:40:34.836 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:40:34.837 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-12T21:40:34.857 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T21:40:34.866 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T21:40:34.919 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T21:40:34.919 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:40:34.922 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:40:34.924 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:40:34.926 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:40:34.943 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T21:40:34.962 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T21:40:34.963 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:40:34.978 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:40:34.981 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:40:34.984 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:40:35.044 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T21:40:35.136 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T21:40:35.153 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T21:40:35.153 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T21:40:35.153 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:40:35.154 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:40:35.154 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:40:35.155 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:40:35.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:40:35.172 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-12T21:40:35.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:40:35.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:40:35.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:40:35.176 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-12T21:40:35.177 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-12T21:40:35.177 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-12T21:40:35.229 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:40:35.230 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-503.el9.x86_64 2024-09-12T21:40:35.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-09-12T21:40:35.233 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:40:35.234 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-12T21:40:35.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-12T21:40:35.235 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:40:35.235 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:40:35.236 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-503.el9.x86_64 2024-09-12T21:40:35.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-09-12T21:40:35.236 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-503.el9.x86_64 2024-09-12T21:40:35.236 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-09-12T21:40:37.590 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T21:40:37.715 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T21:40:37.804 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T21:40:38.568 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-12T21:40:39.491 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T21:40:39.816 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-12T21:40:40.626 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-12T21:40:44.292 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-12T21:40:44.492 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-12T21:40:45.477 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-12T21:40:45.743 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-12T21:40:45.876 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 19 kB 00:00 2024-09-12T21:40:46.780 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T21:40:46.840 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T21:40:46.855 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-12T21:40:48.314 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-12T21:40:49.235 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T21:40:51.627 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-12T21:40:52.253 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-12T21:40:52.345 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T21:40:53.103 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-12T21:40:54.049 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T21:40:54.251 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:40:54.251 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:40:54.359 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-12T21:40:54.360 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:40:54.360 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:40:54.368 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:40:54.369 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 79 M 2024-09-12T21:40:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 126 M 2024-09-12T21:40:54.370 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-12T21:40:54.454 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-12T21:40:54.463 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-12T21:40:54.464 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-12T21:40:54.464 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:40:54.464 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-12T21:40:54.464 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-12T21:40:54.464 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-12T21:40:54.566 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T21:40:54.580 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 271 kB/s | 23 kB 00:00 2024-09-12T21:40:54.646 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 277 kB/s | 23 kB 00:00 2024-09-12T21:40:56.572 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:40:56.573 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:40:56.675 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-12T21:40:56.680 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-12T21:40:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-12T21:40:56.680 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-12T21:40:56.680 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-12T21:40:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:40:56.682 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 79 M 2024-09-12T21:40:56.682 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 126 M 2024-09-12T21:40:56.682 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-12T21:40:56.880 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-12T21:40:56.909 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 223 kB/s | 23 kB 00:00 2024-09-12T21:40:57.293 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T21:40:57.668 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-12T21:40:57.963 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-12T21:40:57.976 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T21:40:57.977 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:40:57.977 INFO:teuthology.orchestra.run.smithi172.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-12T21:40:58.665 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-12T21:40:59.023 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-12T21:40:59.023 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-12T21:40:59.263 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.1 MB/s | 29 MB 00:04 2024-09-12T21:40:59.421 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.0 MB/s | 29 MB 00:04 2024-09-12T21:40:59.738 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.7 MB/s | 35 MB 00:05 2024-09-12T21:40:59.739 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:40:59.739 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-12T21:40:59.771 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T21:40:59.987 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-12T21:40:59.987 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-12T21:41:00.418 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-12T21:41:00.480 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.8 MB/s | 35 MB 00:05 2024-09-12T21:41:00.480 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:41:00.480 INFO:teuthology.orchestra.run.smithi120.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-12T21:41:00.761 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-12T21:41:00.761 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-12T21:41:01.158 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-12T21:41:01.513 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-12T21:41:01.513 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-12T21:41:01.734 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-12T21:41:01.734 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-12T21:41:01.828 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:41:01.828 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:41:01.935 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:41:01.941 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 79 M 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 126 M 2024-09-12T21:41:01.942 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-12T21:41:02.081 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 193 kB/s | 23 kB 00:00 2024-09-12T21:41:02.454 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-12T21:41:02.485 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-12T21:41:02.485 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-12T21:41:02.773 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-12T21:41:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:03.298 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-12T21:41:03.757 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-12T21:41:03.757 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:41:03.757 INFO:teuthology.orchestra.run.smithi053.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-12T21:41:04.180 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-12T21:41:04.471 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-12T21:41:04.876 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-12T21:41:04.876 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-12T21:41:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-12T21:41:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:05.757 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:05.870 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-12T21:41:05.870 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-12T21:41:06.044 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:06.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:07.775 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:07.909 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-12T21:41:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:08.675 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:11.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:11.992 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:12.120 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:12.754 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:12.859 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:13.486 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:15.970 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:17.247 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:17.288 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:17.695 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:18.432 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:22.440 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:53.929 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:53.968 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:54.260 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:54.261 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:54.261 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:54.261 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:55.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:41:55.114 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-12T21:41:55.462 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:55.546 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.547 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:55.547 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:41:55.547 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:41:55.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:41:55.547 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T21:41:55.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:41:55.548 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:55.606 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:55.607 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:55.607 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 82.el9 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:41:55.639 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8274670 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:41:55.640 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:41:55.641 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:41:55.641 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:41:55.641 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-09-12T21:41:55.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:41:55.641 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:41:55.642 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:41:55.642 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:41:55.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:41:56.164 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:56.203 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-09-12T21:41:56.570 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:56.570 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:56.570 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:56.570 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:57.036 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:57.080 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:41:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:41:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:41:57.416 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-12T21:41:57.565 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:41:57.593 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-09-12T21:41:57.595 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-12T21:41:57.611 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.0iHDxGEUui 2024-09-12T21:41:57.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0iHDxGEUui 2024-09-12T21:41:57.680 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.0iHDxGEUui 2024-09-12T21:41:57.787 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:57.817 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.0iHDxGEUui is 6KB 2024-09-12T21:41:57.866 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.0iHDxGEUui 2024-09-12T21:41:57.871 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:57.872 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:41:57.872 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:41:57.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:41:57.872 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T21:41:57.872 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:41:57.873 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:57.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:41:57.931 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.931 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:57.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-12T21:41:57.954 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:41:57.954 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:41:57.954 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:41:57.954 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:41:57.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:41:57.963 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-12T21:41:57.963 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-12T21:41:57.963 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:41:57.964 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:41:57.965 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:41:57.966 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:41:57.966 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:41:57.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:41:58.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-09-12T21:41:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:41:58.302 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-12T21:41:58.585 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-12T21:41:58.636 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:58.719 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.719 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:58.719 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:41:58.719 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:41:58.719 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:41:58.719 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T21:41:58.720 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:41:58.720 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:41:58.778 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:41:58.779 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:41:58.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 82.el9 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-09-12T21:41:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8274670 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:41:58.813 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:41:58.814 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:41:58.815 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:41:58.815 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:41:58.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:41:59.458 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-12T21:41:59.894 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:41:59.936 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-12T21:41:59.938 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-12T21:41:59.953 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.f8fiOpZTlM 2024-09-12T21:41:59.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f8fiOpZTlM 2024-09-12T21:42:00.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.f8fiOpZTlM 2024-09-12T21:42:00.173 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.f8fiOpZTlM is 6KB 2024-09-12T21:42:00.221 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.f8fiOpZTlM 2024-09-12T21:42:00.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:42:00.304 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:42:00.304 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:42:00.304 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:42:00.304 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:42:00.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:42:00.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-12T21:42:00.784 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:42:00.811 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-12T21:42:00.823 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-12T21:42:00.839 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.SShcEH6SYo 2024-09-12T21:42:00.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SShcEH6SYo 2024-09-12T21:42:00.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.SShcEH6SYo 2024-09-12T21:42:01.055 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.SShcEH6SYo is 6KB 2024-09-12T21:42:01.103 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.SShcEH6SYo 2024-09-12T21:42:01.118 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:42:01.181 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:42:01.182 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:42:01.182 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:42:01.182 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:42:01.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:42:01.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-12T21:42:01.658 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:42:01.700 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:42:02.068 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:42:02.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T21:42:02.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T21:42:02.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T21:42:02.907 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:42:02.908 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-12T21:42:03.251 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:42:03.390 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:42:03.391 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:42:03.391 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T21:42:03.391 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T21:42:03.391 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T21:42:03.391 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T21:42:03.391 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T21:42:03.391 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T21:42:03.449 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T21:42:03.450 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T21:42:03.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-09-12T21:42:03.481 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-09-12T21:42:03.481 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 82.el9 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8274670 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-09-12T21:42:03.482 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:42:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T21:42:03.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T21:42:03.484 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-505.el9.x86_64 2024-09-12T21:42:03.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T21:42:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-12T21:42:05.451 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T21:42:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-12T21:42:05.487 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-12T21:42:05.501 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.hILDe1D85W 2024-09-12T21:42:05.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hILDe1D85W 2024-09-12T21:42:05.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.hILDe1D85W 2024-09-12T21:42:05.708 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.hILDe1D85W is 6KB 2024-09-12T21:42:05.755 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.hILDe1D85W 2024-09-12T21:42:05.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T21:42:05.832 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T21:42:05.833 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T21:42:05.833 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T21:42:05.833 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T21:42:05.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T21:42:05.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-12T21:42:28.122 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T21:42:28.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:42:28.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:30.465 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T21:42:30.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:42:30.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:31.336 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T21:42:31.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:42:31.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:35.997 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T21:42:35.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:42:35.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:46.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-12T21:42:48.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-12T21:42:49.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-12T21:42:54.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-12T21:42:55.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:42:55.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:57.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:42:57.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:42:58.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-12T21:42:58.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:42:58.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:00.961 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-12T21:43:01.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-12T21:43:03.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:43:03.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:10.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:43:10.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:12.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:43:12.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:13.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:43:13.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:21.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-12T21:43:31.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-12T21:43:32.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-12T21:43:33.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:43:33.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:34.493 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-12T21:43:34.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:43:34.892 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:43:34.892 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-12T21:43:34.907 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:43:34.907 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:43:34.908 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:43:34.908 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:43:35.909 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T21:43:35.909 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:43:35.991 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-12T21:43:36.023 DEBUG:teuthology.parallel:result is None 2024-09-12T21:43:46.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:43:46.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:46.716 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-12T21:43:47.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:43:47.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:43:47.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:43:47.198 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:43:47.198 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-12T21:43:47.213 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:43:47.213 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:43:47.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:43:47.214 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:43:47.479 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-12T21:43:48.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:43:48.025 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:43:48.026 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-12T21:43:48.073 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:43:48.073 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:43:48.074 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:43:48.074 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:43:48.215 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T21:43:48.215 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:43:48.292 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-12T21:43:48.328 DEBUG:teuthology.parallel:result is None 2024-09-12T21:43:49.075 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T21:43:49.075 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:43:49.164 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-12T21:43:49.222 DEBUG:teuthology.parallel:result is None 2024-09-12T21:44:10.661 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T21:44:25.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:44:25.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:44:26.080 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-12T21:44:26.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:44:26.407 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-505.el9.x86_64"... 2024-09-12T21:44:26.407 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-12T21:44:26.422 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-505.el9.x86_64 2024-09-12T21:44:26.422 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T21:44:26.422 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T21:44:26.423 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T21:44:27.423 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T21:44:27.424 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T21:44:27.485 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-09-12T21:44:27.511 DEBUG:teuthology.parallel:result is None 2024-09-12T21:44:27.511 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T21:44:27.518 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T21:44:27.519 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:44:27.522 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:44:27.525 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:44:27.527 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T21:44:27.545 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T21:44:27.554 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T21:44:27.600 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T21:44:27.600 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:44:27.603 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:44:27.605 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:44:27.608 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T21:44:27.639 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T21:44:27.645 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T21:44:27.646 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:44:27.671 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:44:27.674 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:44:27.676 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T21:44:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.708 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.710 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.713 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.717 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.719 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.721 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.724 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T21:44:27.726 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T21:44:27.733 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T21:44:27.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:44:27.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:44:27.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:44:27.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T21:44:27.795 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T21:44:27.807 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T21:44:27.807 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:44:27.832 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:44:27.834 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:44:27.837 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T21:44:27.853 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:27.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:27.977 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.104 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:44:28.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:44:28.171 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.287 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.372 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:44:28.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:44:28.439 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.545 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.633 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:44:28.634 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:44:28.701 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.741 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T21:44:28.810 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T21:44:28.897 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:44:28.897 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T21:44:28.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-12T21:44:28.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-12T21:44:28.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-12T21:44:28.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-12T21:44:29.017 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:44:29.023 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:44:29.028 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:44:29.048 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:44:29.444 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T21:44:29.457 INFO:teuthology.task.internal:Starting timer... 2024-09-12T21:44:29.457 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T21:44:29.496 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T21:44:29.571 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T21:44:29.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-09-12T21:44:29.631 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-09-12T21:44:29.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-12T21:44:29.675 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-12T21:44:29.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-09-12T21:44:29.725 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-09-12T21:44:29.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-12T21:44:29.798 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-12T21:44:29.800 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T21:44:29.800 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-09-12T21:44:29.821 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-09-12T21:44:29.821 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-12T21:44:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-12T21:44:29.847 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-09-12T21:44:29.872 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-09-12T21:44:29.872 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-12T21:44:29.897 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-12T21:44:29.897 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-12T21:44:29.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:44:29.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:44:29.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:44:29.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:44:29.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:44:29.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:44:29.990 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:44:30.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:44:30.017 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T21:44:30.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:44:30.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:44:30.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:44:30.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-12T21:44:30.159 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T21:44:30.170 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T21:44:30.173 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T21:44:30.286 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T21:44:30.296 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T21:44:30.297 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi120.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T21:48:19.254 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-12T21:48:19.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:48:19.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:48:19.335 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-12T21:48:19.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-12T21:48:19.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:48:19.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:48:19.495 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-12T21:48:19.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:48:19.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:48:19.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:48:19.648 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-12T21:48:19.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T21:48:19.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:48:19.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:48:19.801 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-12T21:48:19.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:48:19.891 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T21:48:19.903 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T21:48:19.903 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T21:48:19.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:48:19.906 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T21:48:19.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:48:19.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T21:48:19.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:48:19.912 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T21:48:19.912 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:48:19.938 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T21:48:19.940 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T21:48:19.941 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T21:48:19.953 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T21:48:19.956 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T21:48:19.957 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T21:48:19.961 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T21:48:19.977 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T21:48:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-12T21:48:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-09-12T21:48:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-09-12T21:48:19.990 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-12T21:48:19.994 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-09-12T21:48:19.997 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-09-12T21:48:20.003 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-12T21:48:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T21:48:20.008 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T21:48:20.016 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-12T21:48:20.016 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T21:48:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T21:48:20.022 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T21:48:20.028 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T21:48:20.030 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T21:48:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T21:48:20.077 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:48:20.080 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:48:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-12T21:48:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:48:20.085 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:48:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-12T21:48:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.092 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.103 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.107 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:48:20.107 INFO:teuthology.run_tasks:Running task install... 2024-09-12T21:48:20.115 DEBUG:teuthology.task.install:project ceph 2024-09-12T21:48:20.116 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T21:48:20.116 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'} 2024-09-12T21:48:20.116 INFO:teuthology.task.install:Using flavor: default 2024-09-12T21:48:20.121 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T21:48:20.121 INFO:teuthology.task.install:extra packages: [] 2024-09-12T21:48:20.122 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T21:48:20.122 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:48:20.125 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T21:48:20.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:48:20.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T21:48:20.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:48:20.127 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T21:48:20.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:48:20.280 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T21:48:20.280 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T21:48:20.292 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T21:48:20.292 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T21:48:20.296 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T21:48:20.296 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T21:48:20.299 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T21:48:20.299 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T21:48:20.397 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T21:48:20.397 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:48:20.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T21:48:20.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T21:48:20.403 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:48:20.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T21:48:20.407 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T21:48:20.407 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:48:20.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T21:48:20.413 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T21:48:20.414 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:48:20.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T21:48:20.424 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T21:48:20.425 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T21:48:20.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T21:48:20.430 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T21:48:20.433 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T21:48:20.433 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T21:48:20.440 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T21:48:20.440 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T21:48:20.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T21:48:20.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T21:48:20.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T21:48:20.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T21:48:20.570 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T21:48:20.572 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T21:48:20.573 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T21:48:20.580 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T21:48:20.636 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-12T21:48:20.636 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-09-12T21:48:20.637 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-12T21:48:20.638 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-09-12T21:48:20.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-09-12T21:48:20.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-09-12T21:48:20.645 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-12T21:48:20.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-12T21:48:20.862 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-12T21:48:20.871 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-12T21:48:20.889 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-09-12T21:48:20.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T21:48:20.891 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-09-12T21:48:20.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T21:48:20.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T21:48:20.919 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T21:48:21.496 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 263 kB/s | 83 kB 00:00 2024-09-12T21:48:21.517 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 279 kB/s | 83 kB 00:00 2024-09-12T21:48:21.518 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 246 kB/s | 83 kB 00:00 2024-09-12T21:48:21.520 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 264 kB/s | 83 kB 00:00 2024-09-12T21:48:21.822 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-09-12T21:48:21.825 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-12T21:48:21.827 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-12T21:48:21.838 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 43 kB/s | 12 kB 00:00 2024-09-12T21:48:22.085 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T21:48:22.103 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T21:48:22.106 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-12T21:48:22.123 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-12T21:48:22.748 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T21:48:24.047 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-12T21:48:24.195 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-12T21:48:24.859 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-12T21:48:25.979 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T21:48:26.860 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T21:48:31.295 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T21:48:31.832 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-12T21:48:32.321 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-12T21:48:32.787 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-12T21:48:33.031 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-12T21:48:33.575 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T21:48:33.905 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-12T21:48:34.676 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T21:48:36.400 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-12T21:48:37.515 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-12T21:48:37.826 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-12T21:48:38.605 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T21:48:39.091 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-12T21:48:39.322 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T21:48:39.903 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T21:48:40.149 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-12T21:48:41.717 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:41.718 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:41.790 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T21:48:41.808 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T21:48:41.809 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T21:48:41.810 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-12T21:48:41.811 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T21:48:41.812 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T21:48:41.813 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T21:48:41.814 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T21:48:41.815 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T21:48:41.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T21:48:41.817 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T21:48:41.818 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T21:48:41.819 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:Install 135 Packages 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 4 Packages 2024-09-12T21:48:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:48:41.821 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 213 M 2024-09-12T21:48:41.821 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-12T21:48:42.307 INFO:teuthology.orchestra.run.smithi053.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-09-12T21:48:42.443 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:42.444 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:42.513 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-12T21:48:42.534 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T21:48:42.534 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T21:48:42.535 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T21:48:42.536 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T21:48:42.537 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T21:48:42.537 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T21:48:42.537 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T21:48:42.537 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T21:48:42.537 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T21:48:42.538 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T21:48:42.538 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T21:48:42.538 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T21:48:42.538 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T21:48:42.538 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T21:48:42.539 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T21:48:42.539 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T21:48:42.539 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T21:48:42.539 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-12T21:48:42.539 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T21:48:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T21:48:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T21:48:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T21:48:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T21:48:42.544 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T21:48:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T21:48:42.546 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T21:48:42.547 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T21:48:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T21:48:42.549 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T21:48:42.550 INFO:teuthology.orchestra.run.smithi172.stdout:Install 135 Packages 2024-09-12T21:48:42.551 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 4 Packages 2024-09-12T21:48:42.551 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:48:42.551 INFO:teuthology.orchestra.run.smithi053.stdout:(2/139): ceph-base-19.1.1-314.g086c737f.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T21:48:42.552 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 213 M 2024-09-12T21:48:42.552 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-12T21:48:42.590 INFO:teuthology.orchestra.run.smithi053.stdout:(3/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 3.1 MB/s | 896 kB 00:00 2024-09-12T21:48:43.233 INFO:teuthology.orchestra.run.smithi053.stdout:(4/139): ceph-common-19.1.1-314.g086c737f.el9.x 19 MB/s | 21 MB 00:01 2024-09-12T21:48:43.257 INFO:teuthology.orchestra.run.smithi053.stdout:(5/139): ceph-immutable-object-cache-19.1.1-314 205 kB/s | 145 kB 00:00 2024-09-12T21:48:43.349 INFO:teuthology.orchestra.run.smithi053.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-12T21:48:43.391 INFO:teuthology.orchestra.run.smithi053.stdout:(7/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-09-12T21:48:43.483 INFO:teuthology.orchestra.run.smithi172.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2024-09-12T21:48:43.533 INFO:teuthology.orchestra.run.smithi053.stdout:(8/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-12T21:48:44.028 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T21:48:44.167 INFO:teuthology.orchestra.run.smithi172.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-12T21:48:44.184 INFO:teuthology.orchestra.run.smithi053.stdout:(9/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 20 MB/s | 17 MB 00:00 2024-09-12T21:48:44.209 INFO:teuthology.orchestra.run.smithi053.stdout:(10/139): ceph-selinux-19.1.1-314.g086c737f.el9 37 kB/s | 25 kB 00:00 2024-09-12T21:48:44.267 INFO:teuthology.orchestra.run.smithi172.stdout:(3/139): ceph-base-19.1.1-314.g086c737f.el9.x86 5.0 MB/s | 5.4 MB 00:01 2024-09-12T21:48:44.292 INFO:teuthology.orchestra.run.smithi172.stdout:(4/139): ceph-immutable-object-cache-19.1.1-314 1.1 MB/s | 145 kB 00:00 2024-09-12T21:48:45.251 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-12T21:48:46.109 INFO:teuthology.orchestra.run.smithi172.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 858 kB/s | 1.5 MB 00:01 2024-09-12T21:48:46.134 INFO:teuthology.orchestra.run.smithi053.stdout:(11/139): ceph-test-19.1.1-314.g086c737f.el9.x8 25 MB/s | 49 MB 00:01 2024-09-12T21:48:46.159 INFO:teuthology.orchestra.run.smithi172.stdout:(6/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 1.3 MB/s | 2.4 MB 00:01 2024-09-12T21:48:46.160 INFO:teuthology.orchestra.run.smithi053.stdout:(12/139): libcephfs-devel-19.1.1-314.g086c737f. 16 kB/s | 32 kB 00:01 2024-09-12T21:48:46.293 INFO:teuthology.orchestra.run.smithi053.stdout:(13/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.6 MB/s | 753 kB 00:00 2024-09-12T21:48:46.355 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:46.356 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:46.410 INFO:teuthology.orchestra.run.smithi053.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.1 MB/s | 127 kB 00:00 2024-09-12T21:48:46.422 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-12T21:48:46.435 INFO:teuthology.orchestra.run.smithi053.stdout:(15/139): libcephsqlite-19.1.1-314.g086c737f.el 594 kB/s | 164 kB 00:00 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T21:48:46.443 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T21:48:46.444 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T21:48:46.445 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-12T21:48:46.446 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T21:48:46.447 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T21:48:46.448 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T21:48:46.449 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T21:48:46.450 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T21:48:46.451 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T21:48:46.452 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T21:48:46.453 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T21:48:46.454 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-12T21:48:46.455 INFO:teuthology.orchestra.run.smithi089.stdout:Install 135 Packages 2024-09-12T21:48:46.456 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 4 Packages 2024-09-12T21:48:46.456 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:48:46.456 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 213 M 2024-09-12T21:48:46.456 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-12T21:48:46.518 INFO:teuthology.orchestra.run.smithi172.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T21:48:46.519 INFO:teuthology.orchestra.run.smithi053.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 4.6 MB/s | 506 kB 00:00 2024-09-12T21:48:46.694 INFO:teuthology.orchestra.run.smithi053.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 258 kB/s | 45 kB 00:00 2024-09-12T21:48:46.828 INFO:teuthology.orchestra.run.smithi053.stdout:(18/139): ceph-radosgw-19.1.1-314.g086c737f.el9 3.1 MB/s | 11 MB 00:03 2024-09-12T21:48:46.936 INFO:teuthology.orchestra.run.smithi053.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.5 MB/s | 162 kB 00:00 2024-09-12T21:48:47.020 INFO:teuthology.orchestra.run.smithi053.stdout:(20/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 9.1 MB/s | 5.3 MB 00:00 2024-09-12T21:48:47.104 INFO:teuthology.orchestra.run.smithi053.stdout:(21/139): python3-ceph-common-19.1.1-314.g086c7 333 kB/s | 136 kB 00:00 2024-09-12T21:48:47.109 INFO:teuthology.orchestra.run.smithi172.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 5.4 MB/s | 21 MB 00:03 2024-09-12T21:48:47.437 INFO:teuthology.orchestra.run.smithi053.stdout:(22/139): python3-rados-19.1.1-314.g086c737f.el 639 kB/s | 320 kB 00:00 2024-09-12T21:48:47.438 INFO:teuthology.orchestra.run.smithi089.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 10 kB/s | 6.5 kB 00:00 2024-09-12T21:48:47.468 INFO:teuthology.orchestra.run.smithi172.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 70 kB/s | 25 kB 00:00 2024-09-12T21:48:47.470 INFO:teuthology.orchestra.run.smithi053.stdout:(23/139): python3-rbd-19.1.1-314.g086c737f.el9. 669 kB/s | 301 kB 00:00 2024-09-12T21:48:47.496 INFO:teuthology.orchestra.run.smithi053.stdout:(24/139): python3-rgw-19.1.1-314.g086c737f.el9. 253 kB/s | 99 kB 00:00 2024-09-12T21:48:47.513 INFO:teuthology.orchestra.run.smithi053.stdout:(25/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T21:48:47.555 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:47.556 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T21:48:47.585 INFO:teuthology.orchestra.run.smithi172.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 9.9 MB/s | 11 MB 00:01 2024-09-12T21:48:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:(26/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.3 MB/s | 171 kB 00:00 2024-09-12T21:48:47.625 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-12T21:48:47.637 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-12T21:48:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-12T21:48:47.637 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T21:48:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T21:48:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T21:48:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T21:48:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T21:48:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T21:48:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T21:48:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T21:48:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T21:48:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T21:48:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T21:48:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T21:48:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:48:47.650 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-12T21:48:47.650 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-12T21:48:47.650 INFO:teuthology.orchestra.run.smithi120.stdout:Install 135 Packages 2024-09-12T21:48:47.650 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 4 Packages 2024-09-12T21:48:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:48:47.651 INFO:teuthology.orchestra.run.smithi053.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 238 kB/s | 32 kB 00:00 2024-09-12T21:48:47.651 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 213 M 2024-09-12T21:48:47.651 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-12T21:48:47.660 INFO:teuthology.orchestra.run.smithi172.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 425 kB/s | 32 kB 00:00 2024-09-12T21:48:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:(28/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-12T21:48:47.739 INFO:teuthology.orchestra.run.smithi053.stdout:(29/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.2 MB/s | 146 kB 00:00 2024-09-12T21:48:47.814 INFO:teuthology.orchestra.run.smithi089.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 2.3 MB/s | 896 kB 00:00 2024-09-12T21:48:47.872 INFO:teuthology.orchestra.run.smithi053.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 1.8 MB/s | 249 kB 00:00 2024-09-12T21:48:47.877 INFO:teuthology.orchestra.run.smithi172.stdout:(12/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 9.8 MB/s | 17 MB 00:01 2024-09-12T21:48:47.911 INFO:teuthology.orchestra.run.smithi172.stdout:(13/139): libcephfs2-19.1.1-314.g086c737f.el9.x 2.9 MB/s | 753 kB 00:00 2024-09-12T21:48:47.930 INFO:teuthology.orchestra.run.smithi089.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.2 MB/s | 145 kB 00:00 2024-09-12T21:48:47.956 INFO:teuthology.orchestra.run.smithi053.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 593 kB/s | 49 kB 00:00 2024-09-12T21:48:47.978 INFO:teuthology.orchestra.run.smithi172.stdout:(14/139): libcephsqlite-19.1.1-314.g086c737f.el 1.6 MB/s | 164 kB 00:00 2024-09-12T21:48:48.003 INFO:teuthology.orchestra.run.smithi172.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 1.3 MB/s | 127 kB 00:00 2024-09-12T21:48:48.031 INFO:teuthology.orchestra.run.smithi053.stdout:(32/139): ceph-mgr-dashboard-19.1.1-314.g086c73 9.3 MB/s | 3.6 MB 00:00 2024-09-12T21:48:48.044 INFO:teuthology.orchestra.run.smithi120.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-12T21:48:48.048 INFO:teuthology.orchestra.run.smithi053.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 179 kB/s | 16 kB 00:00 2024-09-12T21:48:48.070 INFO:teuthology.orchestra.run.smithi172.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 5.4 MB/s | 506 kB 00:00 2024-09-12T21:48:48.140 INFO:teuthology.orchestra.run.smithi053.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 2.6 MB/s | 285 kB 00:00 2024-09-12T21:48:48.249 INFO:teuthology.orchestra.run.smithi053.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 3.7 MB/s | 765 kB 00:00 2024-09-12T21:48:48.341 INFO:teuthology.orchestra.run.smithi053.stdout:(36/139): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T21:48:48.487 INFO:teuthology.orchestra.run.smithi172.stdout:(17/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-12T21:48:48.520 INFO:teuthology.orchestra.run.smithi172.stdout:(18/139): python3-ceph-argparse-19.1.1-314.g086 100 kB/s | 45 kB 00:00 2024-09-12T21:48:48.554 INFO:teuthology.orchestra.run.smithi172.stdout:(19/139): python3-ceph-common-19.1.1-314.g086c7 2.0 MB/s | 136 kB 00:00 2024-09-12T21:48:48.588 INFO:teuthology.orchestra.run.smithi172.stdout:(20/139): python3-cephfs-19.1.1-314.g086c737f.e 2.4 MB/s | 162 kB 00:00 2024-09-12T21:48:48.624 INFO:teuthology.orchestra.run.smithi053.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-12T21:48:48.630 INFO:teuthology.orchestra.run.smithi172.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 4.2 MB/s | 320 kB 00:00 2024-09-12T21:48:48.662 INFO:teuthology.orchestra.run.smithi120.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-12T21:48:48.671 INFO:teuthology.orchestra.run.smithi172.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T21:48:48.697 INFO:teuthology.orchestra.run.smithi172.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T21:48:48.730 INFO:teuthology.orchestra.run.smithi089.stdout:(4/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-09-12T21:48:48.748 INFO:teuthology.orchestra.run.smithi172.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T21:48:48.753 INFO:teuthology.orchestra.run.smithi120.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.5 MB/s | 145 kB 00:00 2024-09-12T21:48:48.848 INFO:teuthology.orchestra.run.smithi172.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T21:48:48.891 INFO:teuthology.orchestra.run.smithi053.stdout:(38/139): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-12T21:48:48.916 INFO:teuthology.orchestra.run.smithi053.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 867 kB/s | 253 kB 00:00 2024-09-12T21:48:48.923 INFO:teuthology.orchestra.run.smithi172.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 425 kB/s | 32 kB 00:00 2024-09-12T21:48:48.973 INFO:teuthology.orchestra.run.smithi172.stdout:(27/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-12T21:48:48.998 INFO:teuthology.orchestra.run.smithi172.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.9 MB/s | 146 kB 00:00 2024-09-12T21:48:49.005 INFO:teuthology.orchestra.run.smithi089.stdout:(5/139): ceph-base-19.1.1-314.g086c737f.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-09-12T21:48:49.016 INFO:teuthology.orchestra.run.smithi053.stdout:(40/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-12T21:48:49.042 INFO:teuthology.orchestra.run.smithi053.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-09-12T21:48:49.134 INFO:teuthology.orchestra.run.smithi053.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T21:48:49.159 INFO:teuthology.orchestra.run.smithi053.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T21:48:49.268 INFO:teuthology.orchestra.run.smithi053.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-09-12T21:48:49.349 INFO:teuthology.orchestra.run.smithi172.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 9.5 MB/s | 3.6 MB 00:00 2024-09-12T21:48:49.381 INFO:teuthology.orchestra.run.smithi089.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 2.3 MB/s | 1.5 MB 00:00 2024-09-12T21:48:49.433 INFO:teuthology.orchestra.run.smithi172.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T21:48:49.460 INFO:teuthology.orchestra.run.smithi053.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-12T21:48:49.508 INFO:teuthology.orchestra.run.smithi172.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 659 kB/s | 49 kB 00:00 2024-09-12T21:48:49.510 INFO:teuthology.orchestra.run.smithi053.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T21:48:49.560 INFO:teuthology.orchestra.run.smithi053.stdout:(47/139): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-09-12T21:48:49.585 INFO:teuthology.orchestra.run.smithi053.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-12T21:48:49.608 INFO:teuthology.orchestra.run.smithi172.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 165 kB/s | 16 kB 00:00 2024-09-12T21:48:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:(4/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 2.8 MB/s | 2.4 MB 00:00 2024-09-12T21:48:49.636 INFO:teuthology.orchestra.run.smithi053.stdout:(49/139): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-12T21:48:49.692 INFO:teuthology.orchestra.run.smithi172.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 3.3 MB/s | 285 kB 00:00 2024-09-12T21:48:49.769 INFO:teuthology.orchestra.run.smithi053.stdout:(50/139): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-12T21:48:49.775 INFO:teuthology.orchestra.run.smithi172.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T21:48:49.820 INFO:teuthology.orchestra.run.smithi053.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T21:48:49.839 INFO:teuthology.orchestra.run.smithi089.stdout:(7/139): ceph-common-19.1.1-314.g086c737f.el9.x 6.9 MB/s | 21 MB 00:03 2024-09-12T21:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout:(52/139): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-12T21:48:49.915 INFO:teuthology.orchestra.run.smithi120.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-09-12T21:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout:(53/139): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 943 kB 00:00 2024-09-12T21:48:49.916 INFO:teuthology.orchestra.run.smithi089.stdout:(8/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 5.2 MB/s | 4.7 MB 00:00 2024-09-12T21:48:49.942 INFO:teuthology.orchestra.run.smithi172.stdout:(35/139): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-12T21:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout:(54/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-12T21:48:49.967 INFO:teuthology.orchestra.run.smithi172.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-12T21:48:49.973 INFO:teuthology.orchestra.run.smithi089.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 431 kB/s | 25 kB 00:00 2024-09-12T21:48:49.979 INFO:teuthology.orchestra.run.smithi053.stdout:(55/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-12T21:48:50.046 INFO:teuthology.orchestra.run.smithi053.stdout:(56/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-12T21:48:50.079 INFO:teuthology.orchestra.run.smithi053.stdout:(57/139): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-12T21:48:50.104 INFO:teuthology.orchestra.run.smithi053.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T21:48:50.138 INFO:teuthology.orchestra.run.smithi053.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-12T21:48:50.163 INFO:teuthology.orchestra.run.smithi053.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T21:48:50.197 INFO:teuthology.orchestra.run.smithi053.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T21:48:50.222 INFO:teuthology.orchestra.run.smithi053.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-12T21:48:50.256 INFO:teuthology.orchestra.run.smithi053.stdout:(63/139): libtool-2.4.6-46.el9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-09-12T21:48:50.423 INFO:teuthology.orchestra.run.smithi053.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-12T21:48:50.437 INFO:teuthology.orchestra.run.smithi120.stdout:(6/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 9.0 MB/s | 4.7 MB 00:00 2024-09-12T21:48:50.460 INFO:teuthology.orchestra.run.smithi172.stdout:(37/139): ceph-test-19.1.1-314.g086c737f.el9.x8 16 MB/s | 49 MB 00:02 2024-09-12T21:48:50.493 INFO:teuthology.orchestra.run.smithi172.stdout:(38/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-12T21:48:50.543 INFO:teuthology.orchestra.run.smithi172.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 332 kB/s | 191 kB 00:00 2024-09-12T21:48:50.593 INFO:teuthology.orchestra.run.smithi172.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-12T21:48:50.598 INFO:teuthology.orchestra.run.smithi053.stdout:(65/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T21:48:50.629 INFO:teuthology.orchestra.run.smithi172.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-12T21:48:50.631 INFO:teuthology.orchestra.run.smithi053.stdout:(66/139): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-12T21:48:50.652 INFO:teuthology.orchestra.run.smithi172.stdout:(42/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-12T21:48:50.657 INFO:teuthology.orchestra.run.smithi053.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T21:48:50.678 INFO:teuthology.orchestra.run.smithi172.stdout:(43/139): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-12T21:48:50.703 INFO:teuthology.orchestra.run.smithi172.stdout:(44/139): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T21:48:50.728 INFO:teuthology.orchestra.run.smithi172.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T21:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout:(68/139): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-12T21:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-12T21:48:50.770 INFO:teuthology.orchestra.run.smithi172.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-12T21:48:50.783 INFO:teuthology.orchestra.run.smithi053.stdout:(70/139): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-12T21:48:50.796 INFO:teuthology.orchestra.run.smithi172.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-12T21:48:50.799 INFO:teuthology.orchestra.run.smithi053.stdout:(71/139): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T21:48:50.807 INFO:teuthology.orchestra.run.smithi089.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 11 MB/s | 11 MB 00:00 2024-09-12T21:48:50.812 INFO:teuthology.orchestra.run.smithi172.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-12T21:48:50.825 INFO:teuthology.orchestra.run.smithi053.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-12T21:48:50.841 INFO:teuthology.orchestra.run.smithi053.stdout:(73/139): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-12T21:48:50.846 INFO:teuthology.orchestra.run.smithi172.stdout:(49/139): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-09-12T21:48:50.863 INFO:teuthology.orchestra.run.smithi172.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-12T21:48:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 425 kB/s | 32 kB 00:00 2024-09-12T21:48:50.883 INFO:teuthology.orchestra.run.smithi053.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T21:48:50.888 INFO:teuthology.orchestra.run.smithi172.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-12T21:48:50.905 INFO:teuthology.orchestra.run.smithi172.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-12T21:48:50.931 INFO:teuthology.orchestra.run.smithi172.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 264 kB/s | 11 kB 00:00 2024-09-12T21:48:50.934 INFO:teuthology.orchestra.run.smithi053.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T21:48:50.956 INFO:teuthology.orchestra.run.smithi172.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T21:48:50.959 INFO:teuthology.orchestra.run.smithi053.stdout:(76/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.8 MB/s | 222 kB 00:00 2024-09-12T21:48:50.973 INFO:teuthology.orchestra.run.smithi172.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T21:48:50.985 INFO:teuthology.orchestra.run.smithi053.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 837 kB/s | 42 kB 00:00 2024-09-12T21:48:51.015 INFO:teuthology.orchestra.run.smithi172.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T21:48:51.030 INFO:teuthology.orchestra.run.smithi089.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 5.0 MB/s | 753 kB 00:00 2024-09-12T21:48:51.052 INFO:teuthology.orchestra.run.smithi053.stdout:(78/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-12T21:48:51.054 INFO:teuthology.orchestra.run.smithi172.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 7.0 MB/s | 581 kB 00:00 2024-09-12T21:48:51.074 INFO:teuthology.orchestra.run.smithi172.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T21:48:51.077 INFO:teuthology.orchestra.run.smithi053.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-12T21:48:51.091 INFO:teuthology.orchestra.run.smithi172.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2024-09-12T21:48:51.102 INFO:teuthology.orchestra.run.smithi053.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-12T21:48:51.116 INFO:teuthology.orchestra.run.smithi172.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-12T21:48:51.127 INFO:teuthology.orchestra.run.smithi053.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-12T21:48:51.146 INFO:teuthology.orchestra.run.smithi120.stdout:(7/139): ceph-common-19.1.1-314.g086c737f.el9.x 6.3 MB/s | 21 MB 00:03 2024-09-12T21:48:51.149 INFO:teuthology.orchestra.run.smithi172.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T21:48:51.153 INFO:teuthology.orchestra.run.smithi053.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-12T21:48:51.166 INFO:teuthology.orchestra.run.smithi172.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-12T21:48:51.178 INFO:teuthology.orchestra.run.smithi053.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-12T21:48:51.183 INFO:teuthology.orchestra.run.smithi089.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.0 MB/s | 164 kB 00:00 2024-09-12T21:48:51.203 INFO:teuthology.orchestra.run.smithi053.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-12T21:48:51.225 INFO:teuthology.orchestra.run.smithi172.stdout:(63/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2024-09-12T21:48:51.236 INFO:teuthology.orchestra.run.smithi053.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T21:48:51.262 INFO:teuthology.orchestra.run.smithi053.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-12T21:48:51.266 INFO:teuthology.orchestra.run.smithi089.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.5 MB/s | 127 kB 00:00 2024-09-12T21:48:51.275 INFO:teuthology.orchestra.run.smithi172.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-09-12T21:48:51.295 INFO:teuthology.orchestra.run.smithi053.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-12T21:48:51.350 INFO:teuthology.orchestra.run.smithi172.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-12T21:48:51.354 INFO:teuthology.orchestra.run.smithi053.stdout:(88/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T21:48:51.375 INFO:teuthology.orchestra.run.smithi089.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 4.6 MB/s | 506 kB 00:00 2024-09-12T21:48:51.379 INFO:teuthology.orchestra.run.smithi053.stdout:(89/139): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T21:48:51.413 INFO:teuthology.orchestra.run.smithi053.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T21:48:51.417 INFO:teuthology.orchestra.run.smithi172.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T21:48:51.438 INFO:teuthology.orchestra.run.smithi053.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-12T21:48:51.443 INFO:teuthology.orchestra.run.smithi172.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T21:48:51.476 INFO:teuthology.orchestra.run.smithi172.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T21:48:51.493 INFO:teuthology.orchestra.run.smithi172.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T21:48:51.510 INFO:teuthology.orchestra.run.smithi172.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-09-12T21:48:51.544 INFO:teuthology.orchestra.run.smithi172.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T21:48:51.547 INFO:teuthology.orchestra.run.smithi053.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-12T21:48:51.569 INFO:teuthology.orchestra.run.smithi172.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-12T21:48:51.619 INFO:teuthology.orchestra.run.smithi172.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-12T21:48:51.697 INFO:teuthology.orchestra.run.smithi053.stdout:(93/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-12T21:48:51.703 INFO:teuthology.orchestra.run.smithi172.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-12T21:48:51.728 INFO:teuthology.orchestra.run.smithi172.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T21:48:51.753 INFO:teuthology.orchestra.run.smithi172.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T21:48:51.754 INFO:teuthology.orchestra.run.smithi120.stdout:(8/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 13 MB/s | 17 MB 00:01 2024-09-12T21:48:51.755 INFO:teuthology.orchestra.run.smithi053.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 2.6 MB/s | 548 kB 00:00 2024-09-12T21:48:51.779 INFO:teuthology.orchestra.run.smithi172.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-12T21:48:51.781 INFO:teuthology.orchestra.run.smithi053.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-12T21:48:51.804 INFO:teuthology.orchestra.run.smithi172.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T21:48:51.806 INFO:teuthology.orchestra.run.smithi053.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.0 MB/s | 308 kB 00:00 2024-09-12T21:48:51.830 INFO:teuthology.orchestra.run.smithi120.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 336 kB/s | 25 kB 00:00 2024-09-12T21:48:51.831 INFO:teuthology.orchestra.run.smithi053.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T21:48:51.838 INFO:teuthology.orchestra.run.smithi172.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-12T21:48:51.856 INFO:teuthology.orchestra.run.smithi053.stdout:(98/139): protobuf-compiler-3.14.0-13.el9.x86_6 2.0 MB/s | 863 kB 00:00 2024-09-12T21:48:51.890 INFO:teuthology.orchestra.run.smithi053.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-09-12T21:48:51.905 INFO:teuthology.orchestra.run.smithi172.stdout:(80/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-12T21:48:51.905 INFO:teuthology.orchestra.run.smithi120.stdout:(10/139): ceph-base-19.1.1-314.g086c737f.el9.x8 1.3 MB/s | 5.4 MB 00:04 2024-09-12T21:48:51.923 INFO:teuthology.orchestra.run.smithi053.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-09-12T21:48:51.930 INFO:teuthology.orchestra.run.smithi172.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T21:48:51.949 INFO:teuthology.orchestra.run.smithi053.stdout:(101/139): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-12T21:48:51.955 INFO:teuthology.orchestra.run.smithi172.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-12T21:48:51.981 INFO:teuthology.orchestra.run.smithi172.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-12T21:48:51.989 INFO:teuthology.orchestra.run.smithi120.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 381 kB/s | 32 kB 00:00 2024-09-12T21:48:51.991 INFO:teuthology.orchestra.run.smithi053.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T21:48:52.006 INFO:teuthology.orchestra.run.smithi172.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-12T21:48:52.007 INFO:teuthology.orchestra.run.smithi053.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T21:48:52.031 INFO:teuthology.orchestra.run.smithi172.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T21:48:52.033 INFO:teuthology.orchestra.run.smithi053.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T21:48:52.050 INFO:teuthology.orchestra.run.smithi053.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 769 kB/s | 32 kB 00:00 2024-09-12T21:48:52.057 INFO:teuthology.orchestra.run.smithi172.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-12T21:48:52.067 INFO:teuthology.orchestra.run.smithi053.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-12T21:48:52.081 INFO:teuthology.orchestra.run.smithi172.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-12T21:48:52.092 INFO:teuthology.orchestra.run.smithi053.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T21:48:52.107 INFO:teuthology.orchestra.run.smithi172.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T21:48:52.114 INFO:teuthology.orchestra.run.smithi120.stdout:(12/139): ceph-radosgw-19.1.1-314.g086c737f.el9 11 MB/s | 11 MB 00:00 2024-09-12T21:48:52.117 INFO:teuthology.orchestra.run.smithi053.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T21:48:52.126 INFO:teuthology.orchestra.run.smithi089.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 7.1 MB/s | 5.3 MB 00:00 2024-09-12T21:48:52.132 INFO:teuthology.orchestra.run.smithi172.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T21:48:52.151 INFO:teuthology.orchestra.run.smithi053.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T21:48:52.157 INFO:teuthology.orchestra.run.smithi172.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T21:48:52.177 INFO:teuthology.orchestra.run.smithi053.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T21:48:52.183 INFO:teuthology.orchestra.run.smithi172.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T21:48:52.190 INFO:teuthology.orchestra.run.smithi120.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.1 MB/s | 164 kB 00:00 2024-09-12T21:48:52.192 INFO:teuthology.orchestra.run.smithi089.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 678 kB/s | 45 kB 00:00 2024-09-12T21:48:52.202 INFO:teuthology.orchestra.run.smithi053.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T21:48:52.227 INFO:teuthology.orchestra.run.smithi053.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T21:48:52.248 INFO:teuthology.orchestra.run.smithi120.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 2.1 MB/s | 127 kB 00:00 2024-09-12T21:48:52.252 INFO:teuthology.orchestra.run.smithi053.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-12T21:48:52.278 INFO:teuthology.orchestra.run.smithi053.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T21:48:52.285 INFO:teuthology.orchestra.run.smithi089.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.4 MB/s | 136 kB 00:00 2024-09-12T21:48:52.303 INFO:teuthology.orchestra.run.smithi053.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-12T21:48:52.307 INFO:teuthology.orchestra.run.smithi120.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 8.5 MB/s | 506 kB 00:00 2024-09-12T21:48:52.370 INFO:teuthology.orchestra.run.smithi053.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-12T21:48:52.398 INFO:teuthology.orchestra.run.smithi120.stdout:(16/139): libcephfs2-19.1.1-314.g086c737f.el9.x 1.8 MB/s | 753 kB 00:00 2024-09-12T21:48:52.403 INFO:teuthology.orchestra.run.smithi053.stdout:(117/139): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-12T21:48:52.416 INFO:teuthology.orchestra.run.smithi172.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T21:48:52.433 INFO:teuthology.orchestra.run.smithi172.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T21:48:52.466 INFO:teuthology.orchestra.run.smithi120.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 677 kB/s | 45 kB 00:00 2024-09-12T21:48:52.470 INFO:teuthology.orchestra.run.smithi053.stdout:(118/139): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-12T21:48:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 8.0 MB/s | 548 kB 00:00 2024-09-12T21:48:52.495 INFO:teuthology.orchestra.run.smithi053.stdout:(119/139): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2024-09-12T21:48:52.500 INFO:teuthology.orchestra.run.smithi172.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T21:48:52.521 INFO:teuthology.orchestra.run.smithi053.stdout:(120/139): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-09-12T21:48:52.526 INFO:teuthology.orchestra.run.smithi172.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-12T21:48:52.543 INFO:teuthology.orchestra.run.smithi172.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-12T21:48:52.560 INFO:teuthology.orchestra.run.smithi172.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T21:48:52.566 INFO:teuthology.orchestra.run.smithi120.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.3 MB/s | 136 kB 00:00 2024-09-12T21:48:52.571 INFO:teuthology.orchestra.run.smithi053.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 769 kB/s | 58 kB 00:00 2024-09-12T21:48:52.585 INFO:teuthology.orchestra.run.smithi172.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T21:48:52.596 INFO:teuthology.orchestra.run.smithi053.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-12T21:48:52.610 INFO:teuthology.orchestra.run.smithi172.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T21:48:52.621 INFO:teuthology.orchestra.run.smithi053.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T21:48:52.647 INFO:teuthology.orchestra.run.smithi053.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T21:48:52.650 INFO:teuthology.orchestra.run.smithi120.stdout:(19/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-12T21:48:52.652 INFO:teuthology.orchestra.run.smithi172.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T21:48:52.672 INFO:teuthology.orchestra.run.smithi053.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T21:48:52.683 INFO:teuthology.orchestra.run.smithi120.stdout:(20/139): python3-cephfs-19.1.1-314.g086c737f.e 1.3 MB/s | 162 kB 00:00 2024-09-12T21:48:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T21:48:52.697 INFO:teuthology.orchestra.run.smithi053.stdout:(126/139): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-12T21:48:52.709 INFO:teuthology.orchestra.run.smithi120.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 5.3 MB/s | 320 kB 00:00 2024-09-12T21:48:52.711 INFO:teuthology.orchestra.run.smithi172.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T21:48:52.722 INFO:teuthology.orchestra.run.smithi053.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T21:48:52.735 INFO:teuthology.orchestra.run.smithi089.stdout:(19/139): ceph-test-19.1.1-314.g086c737f.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T21:48:52.736 INFO:teuthology.orchestra.run.smithi172.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T21:48:52.748 INFO:teuthology.orchestra.run.smithi053.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T21:48:52.753 INFO:teuthology.orchestra.run.smithi172.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 856 kB/s | 14 kB 00:00 2024-09-12T21:48:52.760 INFO:teuthology.orchestra.run.smithi089.stdout:(20/139): python3-cephfs-19.1.1-314.g086c737f.e 341 kB/s | 162 kB 00:00 2024-09-12T21:48:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T21:48:52.773 INFO:teuthology.orchestra.run.smithi053.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-12T21:48:52.794 INFO:teuthology.orchestra.run.smithi089.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 5.4 MB/s | 320 kB 00:00 2024-09-12T21:48:52.798 INFO:teuthology.orchestra.run.smithi053.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T21:48:52.801 INFO:teuthology.orchestra.run.smithi120.stdout:(23/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.5 MB/s | 301 kB 00:00 2024-09-12T21:48:52.804 INFO:teuthology.orchestra.run.smithi172.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T21:48:52.824 INFO:teuthology.orchestra.run.smithi053.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T21:48:52.826 INFO:teuthology.orchestra.run.smithi120.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T21:48:52.828 INFO:teuthology.orchestra.run.smithi089.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T21:48:52.837 INFO:teuthology.orchestra.run.smithi172.stdout:(107/139): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T21:48:52.849 INFO:teuthology.orchestra.run.smithi053.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T21:48:52.853 INFO:teuthology.orchestra.run.smithi089.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T21:48:52.874 INFO:teuthology.orchestra.run.smithi053.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T21:48:52.878 INFO:teuthology.orchestra.run.smithi089.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T21:48:52.885 INFO:teuthology.orchestra.run.smithi120.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T21:48:52.896 INFO:teuthology.orchestra.run.smithi172.stdout:(108/139): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T21:48:52.899 INFO:teuthology.orchestra.run.smithi053.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T21:48:52.921 INFO:teuthology.orchestra.run.smithi172.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T21:48:52.944 INFO:teuthology.orchestra.run.smithi120.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 547 kB/s | 32 kB 00:00 2024-09-12T21:48:52.949 INFO:teuthology.orchestra.run.smithi053.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T21:48:52.954 INFO:teuthology.orchestra.run.smithi172.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T21:48:52.970 INFO:teuthology.orchestra.run.smithi089.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T21:48:52.988 INFO:teuthology.orchestra.run.smithi172.stdout:(111/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-12T21:48:53.005 INFO:teuthology.orchestra.run.smithi172.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T21:48:53.019 INFO:teuthology.orchestra.run.smithi120.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.9 MB/s | 146 kB 00:00 2024-09-12T21:48:53.037 INFO:teuthology.orchestra.run.smithi089.stdout:(26/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-12T21:48:53.038 INFO:teuthology.orchestra.run.smithi172.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 897 kB/s | 23 kB 00:00 2024-09-12T21:48:53.063 INFO:teuthology.orchestra.run.smithi089.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 345 kB/s | 32 kB 00:00 2024-09-12T21:48:53.073 INFO:teuthology.orchestra.run.smithi172.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 612 kB/s | 19 kB 00:00 2024-09-12T21:48:53.098 INFO:teuthology.orchestra.run.smithi172.stdout:(115/139): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-09-12T21:48:53.123 INFO:teuthology.orchestra.run.smithi172.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T21:48:53.140 INFO:teuthology.orchestra.run.smithi089.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.4 MB/s | 146 kB 00:00 2024-09-12T21:48:53.148 INFO:teuthology.orchestra.run.smithi172.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T21:48:53.173 INFO:teuthology.orchestra.run.smithi172.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T21:48:53.199 INFO:teuthology.orchestra.run.smithi172.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T21:48:53.232 INFO:teuthology.orchestra.run.smithi172.stdout:(120/139): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T21:48:53.257 INFO:teuthology.orchestra.run.smithi172.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-12T21:48:53.283 INFO:teuthology.orchestra.run.smithi172.stdout:(122/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T21:48:53.300 INFO:teuthology.orchestra.run.smithi172.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-12T21:48:53.334 INFO:teuthology.orchestra.run.smithi172.stdout:(124/139): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-12T21:48:53.375 INFO:teuthology.orchestra.run.smithi053.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 6.8 MB/s | 3.4 MB 00:00 2024-09-12T21:48:53.376 INFO:teuthology.orchestra.run.smithi172.stdout:(125/139): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-12T21:48:53.387 INFO:teuthology.orchestra.run.smithi120.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 9.7 MB/s | 3.6 MB 00:00 2024-09-12T21:48:53.409 INFO:teuthology.orchestra.run.smithi172.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-12T21:48:53.434 INFO:teuthology.orchestra.run.smithi172.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-09-12T21:48:53.459 INFO:teuthology.orchestra.run.smithi172.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-09-12T21:48:53.485 INFO:teuthology.orchestra.run.smithi172.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-12T21:48:53.510 INFO:teuthology.orchestra.run.smithi172.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T21:48:53.535 INFO:teuthology.orchestra.run.smithi172.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T21:48:53.560 INFO:teuthology.orchestra.run.smithi172.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T21:48:53.586 INFO:teuthology.orchestra.run.smithi172.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T21:48:53.619 INFO:teuthology.orchestra.run.smithi172.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T21:48:53.638 INFO:teuthology.orchestra.run.smithi089.stdout:(29/139): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-12T21:48:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T21:48:53.697 INFO:teuthology.orchestra.run.smithi089.stdout:(30/139): ceph-mgr-dashboard-19.1.1-314.g086c73 5.6 MB/s | 3.6 MB 00:00 2024-09-12T21:48:53.722 INFO:teuthology.orchestra.run.smithi089.stdout:(31/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T21:48:53.748 INFO:teuthology.orchestra.run.smithi089.stdout:(32/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 981 kB/s | 49 kB 00:00 2024-09-12T21:48:53.773 INFO:teuthology.orchestra.run.smithi089.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 326 kB/s | 16 kB 00:00 2024-09-12T21:48:53.783 INFO:teuthology.orchestra.run.smithi053.stdout:(137/139): openssl-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 1.4 MB 00:00 2024-09-12T21:48:53.787 INFO:teuthology.orchestra.run.smithi172.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-12T21:48:53.815 INFO:teuthology.orchestra.run.smithi089.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T21:48:53.857 INFO:teuthology.orchestra.run.smithi089.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-12T21:48:53.870 INFO:teuthology.orchestra.run.smithi172.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-12T21:48:53.966 INFO:teuthology.orchestra.run.smithi089.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-12T21:48:53.978 INFO:teuthology.orchestra.run.smithi120.stdout:(29/139): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-12T21:48:54.020 INFO:teuthology.orchestra.run.smithi172.stdout:(138/139): librados2-19.1.1-314.g086c737f.el9.x 7.9 MB/s | 3.4 MB 00:00 2024-09-12T21:48:54.037 INFO:teuthology.orchestra.run.smithi120.stdout:(30/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 2.5 MB/s | 3.1 MB 00:01 2024-09-12T21:48:54.057 INFO:teuthology.orchestra.run.smithi089.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T21:48:54.062 INFO:teuthology.orchestra.run.smithi120.stdout:(31/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T21:48:54.079 INFO:teuthology.orchestra.run.smithi172.stdout:(139/139): librbd1-19.1.1-314.g086c737f.el9.x86 6.9 MB/s | 3.2 MB 00:00 2024-09-12T21:48:54.085 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:48:54.085 INFO:teuthology.orchestra.run.smithi172.stdout:Total 18 MB/s | 213 MB 00:11 2024-09-12T21:48:54.088 INFO:teuthology.orchestra.run.smithi120.stdout:(32/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 978 kB/s | 49 kB 00:00 2024-09-12T21:48:54.113 INFO:teuthology.orchestra.run.smithi120.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 327 kB/s | 16 kB 00:00 2024-09-12T21:48:54.141 INFO:teuthology.orchestra.run.smithi089.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T21:48:54.175 INFO:teuthology.orchestra.run.smithi089.stdout:(39/139): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T21:48:54.234 INFO:teuthology.orchestra.run.smithi089.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T21:48:54.292 INFO:teuthology.orchestra.run.smithi053.stdout:(138/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 2.4 MB 00:00 2024-09-12T21:48:54.292 INFO:teuthology.orchestra.run.smithi089.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T21:48:54.326 INFO:teuthology.orchestra.run.smithi089.stdout:(42/139): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-12T21:48:54.360 INFO:teuthology.orchestra.run.smithi089.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-12T21:48:54.394 INFO:teuthology.orchestra.run.smithi089.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-12T21:48:54.475 INFO:teuthology.orchestra.run.smithi053.stdout:(139/139): librbd1-19.1.1-314.g086c737f.el9.x86 2.0 MB/s | 3.2 MB 00:01 2024-09-12T21:48:54.481 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:48:54.481 INFO:teuthology.orchestra.run.smithi053.stdout:Total 17 MB/s | 213 MB 00:12 2024-09-12T21:48:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:(34/139): ceph-test-19.1.1-314.g086c737f.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T21:48:54.588 INFO:teuthology.orchestra.run.smithi120.stdout:(35/139): ceph-volume-19.1.1-314.g086c737f.el9. 570 kB/s | 285 kB 00:00 2024-09-12T21:48:54.631 INFO:teuthology.orchestra.run.smithi120.stdout:(36/139): cephadm-19.1.1-314.g086c737f.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-12T21:48:54.661 INFO:teuthology.orchestra.run.smithi089.stdout:(45/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 3.2 MB/s | 17 MB 00:05 2024-09-12T21:48:54.786 INFO:teuthology.orchestra.run.smithi089.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-12T21:48:54.820 INFO:teuthology.orchestra.run.smithi089.stdout:(47/139): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-09-12T21:48:54.837 INFO:teuthology.orchestra.run.smithi089.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 430 kB/s | 22 kB 00:00 2024-09-12T21:48:54.870 INFO:teuthology.orchestra.run.smithi089.stdout:(49/139): boost-program-options-1.75.0-8.el9.x8 511 kB/s | 107 kB 00:00 2024-09-12T21:48:54.895 INFO:teuthology.orchestra.run.smithi089.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-12T21:48:54.929 INFO:teuthology.orchestra.run.smithi089.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T21:48:54.939 INFO:teuthology.orchestra.run.smithi120.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 213 kB/s | 80 kB 00:00 2024-09-12T21:48:54.954 INFO:teuthology.orchestra.run.smithi089.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-12T21:48:54.980 INFO:teuthology.orchestra.run.smithi089.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-12T21:48:55.022 INFO:teuthology.orchestra.run.smithi089.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-12T21:48:55.047 INFO:teuthology.orchestra.run.smithi089.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-09-12T21:48:55.105 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-12T21:48:55.114 INFO:teuthology.orchestra.run.smithi089.stdout:(56/139): libtool-2.4.6-46.el9.x86_64.rpm 8.6 MB/s | 581 kB 00:00 2024-09-12T21:48:55.165 INFO:teuthology.orchestra.run.smithi089.stdout:(57/139): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-12T21:48:55.193 INFO:teuthology.orchestra.run.smithi089.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-12T21:48:55.193 INFO:teuthology.orchestra.run.smithi120.stdout:(38/139): libquadmath-11.5.0-2.el9.x86_64.rpm 342 kB/s | 191 kB 00:00 2024-09-12T21:48:55.232 INFO:teuthology.orchestra.run.smithi089.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-12T21:48:55.245 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-12T21:48:55.246 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-12T21:48:55.256 INFO:teuthology.orchestra.run.smithi120.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 799 kB/s | 253 kB 00:00 2024-09-12T21:48:55.265 INFO:teuthology.orchestra.run.smithi089.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T21:48:55.324 INFO:teuthology.orchestra.run.smithi089.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T21:48:55.349 INFO:teuthology.orchestra.run.smithi089.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T21:48:55.373 INFO:teuthology.orchestra.run.smithi120.stdout:(40/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-12T21:48:55.399 INFO:teuthology.orchestra.run.smithi120.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 750 kB/s | 106 kB 00:00 2024-09-12T21:48:55.416 INFO:teuthology.orchestra.run.smithi089.stdout:(63/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.5 MB/s | 3.0 MB 00:00 2024-09-12T21:48:55.528 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-12T21:48:55.532 INFO:teuthology.orchestra.run.smithi120.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 851 kB/s | 135 kB 00:00 2024-09-12T21:48:55.557 INFO:teuthology.orchestra.run.smithi120.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 787 kB/s | 125 kB 00:00 2024-09-12T21:48:55.601 INFO:teuthology.orchestra.run.smithi120.stdout:(44/139): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-09-12T21:48:55.683 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-12T21:48:55.683 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-12T21:48:55.684 INFO:teuthology.orchestra.run.smithi120.stdout:(45/139): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-12T21:48:55.875 INFO:teuthology.orchestra.run.smithi120.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-12T21:48:55.901 INFO:teuthology.orchestra.run.smithi120.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 492 kB/s | 107 kB 00:00 2024-09-12T21:48:55.943 INFO:teuthology.orchestra.run.smithi120.stdout:(48/139): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-12T21:48:55.968 INFO:teuthology.orchestra.run.smithi120.stdout:(49/139): elfutils-libelf-devel-0.191-4.el9.x86 235 kB/s | 22 kB 00:00 2024-09-12T21:48:56.010 INFO:teuthology.orchestra.run.smithi120.stdout:(50/139): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T21:48:56.035 INFO:teuthology.orchestra.run.smithi120.stdout:(51/139): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-12T21:48:56.052 INFO:teuthology.orchestra.run.smithi120.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-12T21:48:56.128 INFO:teuthology.orchestra.run.smithi120.stdout:(53/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-12T21:48:56.145 INFO:teuthology.orchestra.run.smithi120.stdout:(54/139): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-12T21:48:56.170 INFO:teuthology.orchestra.run.smithi120.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T21:48:56.195 INFO:teuthology.orchestra.run.smithi120.stdout:(56/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-12T21:48:56.233 INFO:teuthology.orchestra.run.smithi089.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-12T21:48:56.287 INFO:teuthology.orchestra.run.smithi120.stdout:(57/139): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-12T21:48:56.329 INFO:teuthology.orchestra.run.smithi120.stdout:(58/139): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-12T21:48:56.355 INFO:teuthology.orchestra.run.smithi120.stdout:(59/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 154 kB/s | 24 kB 00:00 2024-09-12T21:48:56.380 INFO:teuthology.orchestra.run.smithi120.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-09-12T21:48:56.405 INFO:teuthology.orchestra.run.smithi120.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T21:48:56.431 INFO:teuthology.orchestra.run.smithi120.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-12T21:48:56.456 INFO:teuthology.orchestra.run.smithi120.stdout:(63/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T21:48:56.523 INFO:teuthology.orchestra.run.smithi120.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T21:48:56.589 INFO:teuthology.orchestra.run.smithi120.stdout:(65/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T21:48:56.657 INFO:teuthology.orchestra.run.smithi120.stdout:(66/139): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-12T21:48:56.690 INFO:teuthology.orchestra.run.smithi120.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T21:48:56.716 INFO:teuthology.orchestra.run.smithi120.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T21:48:56.741 INFO:teuthology.orchestra.run.smithi120.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-12T21:48:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T21:48:56.792 INFO:teuthology.orchestra.run.smithi120.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T21:48:56.817 INFO:teuthology.orchestra.run.smithi120.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-09-12T21:48:56.918 INFO:teuthology.orchestra.run.smithi120.stdout:(73/139): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T21:48:56.934 INFO:teuthology.orchestra.run.smithi089.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 3.1 MB/s | 4.9 MB 00:01 2024-09-12T21:48:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-12T21:48:56.976 INFO:teuthology.orchestra.run.smithi120.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T21:48:57.001 INFO:teuthology.orchestra.run.smithi120.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T21:48:57.027 INFO:teuthology.orchestra.run.smithi120.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-12T21:48:57.061 INFO:teuthology.orchestra.run.smithi120.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T21:48:57.076 INFO:teuthology.orchestra.run.smithi089.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-12T21:48:57.086 INFO:teuthology.orchestra.run.smithi120.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T21:48:57.111 INFO:teuthology.orchestra.run.smithi120.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T21:48:57.136 INFO:teuthology.orchestra.run.smithi120.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T21:48:57.162 INFO:teuthology.orchestra.run.smithi120.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T21:48:57.237 INFO:teuthology.orchestra.run.smithi120.stdout:(83/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-12T21:48:57.251 INFO:teuthology.orchestra.run.smithi089.stdout:(67/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-09-12T21:48:57.262 INFO:teuthology.orchestra.run.smithi120.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T21:48:57.285 INFO:teuthology.orchestra.run.smithi089.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-09-12T21:48:57.288 INFO:teuthology.orchestra.run.smithi120.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T21:48:57.310 INFO:teuthology.orchestra.run.smithi089.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-12T21:48:57.313 INFO:teuthology.orchestra.run.smithi120.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-12T21:48:57.316 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-12T21:48:57.316 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-12T21:48:57.335 INFO:teuthology.orchestra.run.smithi089.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-12T21:48:57.338 INFO:teuthology.orchestra.run.smithi120.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T21:48:57.364 INFO:teuthology.orchestra.run.smithi120.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T21:48:57.369 INFO:teuthology.orchestra.run.smithi089.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T21:48:57.389 INFO:teuthology.orchestra.run.smithi120.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T21:48:57.394 INFO:teuthology.orchestra.run.smithi089.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-12T21:48:57.414 INFO:teuthology.orchestra.run.smithi120.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T21:48:57.448 INFO:teuthology.orchestra.run.smithi120.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-12T21:48:57.545 INFO:teuthology.orchestra.run.smithi089.stdout:(73/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-12T21:48:57.603 INFO:teuthology.orchestra.run.smithi089.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T21:48:57.628 INFO:teuthology.orchestra.run.smithi089.stdout:(75/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 250 kB 00:00 2024-09-12T21:48:57.653 INFO:teuthology.orchestra.run.smithi089.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T21:48:57.688 INFO:teuthology.orchestra.run.smithi089.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-12T21:48:57.713 INFO:teuthology.orchestra.run.smithi089.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T21:48:57.748 INFO:teuthology.orchestra.run.smithi120.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T21:48:57.772 INFO:teuthology.orchestra.run.smithi089.stdout:(79/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-12T21:48:57.773 INFO:teuthology.orchestra.run.smithi120.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 62 kB/s | 22 kB 00:00 2024-09-12T21:48:57.822 INFO:teuthology.orchestra.run.smithi089.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T21:48:57.832 INFO:teuthology.orchestra.run.smithi120.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 6.4 MB/s | 548 kB 00:00 2024-09-12T21:48:57.839 INFO:teuthology.orchestra.run.smithi089.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 763 kB/s | 51 kB 00:00 2024-09-12T21:48:57.842 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-12T21:48:57.843 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-12T21:48:57.858 INFO:teuthology.orchestra.run.smithi120.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-12T21:48:57.872 INFO:teuthology.orchestra.run.smithi089.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T21:48:57.882 INFO:teuthology.orchestra.run.smithi120.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.8 MB/s | 308 kB 00:00 2024-09-12T21:48:57.908 INFO:teuthology.orchestra.run.smithi120.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T21:48:57.931 INFO:teuthology.orchestra.run.smithi089.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 716 kB/s | 42 kB 00:00 2024-09-12T21:48:57.933 INFO:teuthology.orchestra.run.smithi120.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T21:48:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T21:48:57.984 INFO:teuthology.orchestra.run.smithi120.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T21:48:58.034 INFO:teuthology.orchestra.run.smithi120.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T21:48:58.060 INFO:teuthology.orchestra.run.smithi120.stdout:(102/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-12T21:48:58.102 INFO:teuthology.orchestra.run.smithi120.stdout:(103/139): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T21:48:58.127 INFO:teuthology.orchestra.run.smithi120.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-12T21:48:58.153 INFO:teuthology.orchestra.run.smithi120.stdout:(105/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-12T21:48:58.178 INFO:teuthology.orchestra.run.smithi120.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T21:48:58.212 INFO:teuthology.orchestra.run.smithi120.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T21:48:58.223 INFO:teuthology.orchestra.run.smithi089.stdout:(84/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-12T21:48:58.237 INFO:teuthology.orchestra.run.smithi120.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T21:48:58.248 INFO:teuthology.orchestra.run.smithi089.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 697 kB/s | 221 kB 00:00 2024-09-12T21:48:58.266 INFO:teuthology.orchestra.run.smithi089.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-09-12T21:48:58.296 INFO:teuthology.orchestra.run.smithi120.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T21:48:58.329 INFO:teuthology.orchestra.run.smithi120.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T21:48:58.349 INFO:teuthology.orchestra.run.smithi089.stdout:(87/139): python3-babel-2.9.1-2.el9.noarch.rpm 2.8 MB/s | 6.0 MB 00:02 2024-09-12T21:48:58.374 INFO:teuthology.orchestra.run.smithi089.stdout:(88/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-09-12T21:48:58.396 INFO:teuthology.orchestra.run.smithi120.stdout:(111/139): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-12T21:48:58.400 INFO:teuthology.orchestra.run.smithi089.stdout:(89/139): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-12T21:48:58.413 INFO:teuthology.orchestra.run.smithi120.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-12T21:48:58.425 INFO:teuthology.orchestra.run.smithi089.stdout:(90/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-12T21:48:58.430 INFO:teuthology.orchestra.run.smithi120.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-09-12T21:48:58.455 INFO:teuthology.orchestra.run.smithi120.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-09-12T21:48:58.458 INFO:teuthology.orchestra.run.smithi089.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 756 kB/s | 64 kB 00:00 2024-09-12T21:48:58.481 INFO:teuthology.orchestra.run.smithi120.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-12T21:48:58.484 INFO:teuthology.orchestra.run.smithi089.stdout:(92/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 533 kB/s | 45 kB 00:00 2024-09-12T21:48:58.506 INFO:teuthology.orchestra.run.smithi120.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T21:48:58.531 INFO:teuthology.orchestra.run.smithi120.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T21:48:58.534 INFO:teuthology.orchestra.run.smithi089.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 11 MB/s | 548 kB 00:00 2024-09-12T21:48:58.556 INFO:teuthology.orchestra.run.smithi120.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T21:48:58.560 INFO:teuthology.orchestra.run.smithi089.stdout:(94/139): lua-devel-5.4.4-4.el9.x86_64.rpm 165 kB/s | 22 kB 00:00 2024-09-12T21:48:58.582 INFO:teuthology.orchestra.run.smithi120.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T21:48:58.593 INFO:teuthology.orchestra.run.smithi089.stdout:(95/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 5.1 MB/s | 308 kB 00:00 2024-09-12T21:48:58.619 INFO:teuthology.orchestra.run.smithi089.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T21:48:58.641 INFO:teuthology.orchestra.run.smithi120.stdout:(120/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-09-12T21:48:58.644 INFO:teuthology.orchestra.run.smithi089.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T21:48:58.669 INFO:teuthology.orchestra.run.smithi120.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T21:48:58.669 INFO:teuthology.orchestra.run.smithi089.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T21:48:58.691 INFO:teuthology.orchestra.run.smithi120.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-12T21:48:58.703 INFO:teuthology.orchestra.run.smithi089.stdout:(99/139): protobuf-compiler-3.14.0-13.el9.x86_6 3.5 MB/s | 863 kB 00:00 2024-09-12T21:48:58.716 INFO:teuthology.orchestra.run.smithi120.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T21:48:58.737 INFO:teuthology.orchestra.run.smithi089.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-12T21:48:58.750 INFO:teuthology.orchestra.run.smithi120.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-12T21:48:58.778 INFO:teuthology.orchestra.run.smithi089.stdout:(101/139): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T21:48:58.784 INFO:teuthology.orchestra.run.smithi120.stdout:(125/139): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-09-12T21:48:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-12T21:48:58.834 INFO:teuthology.orchestra.run.smithi120.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T21:48:58.860 INFO:teuthology.orchestra.run.smithi120.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-12T21:48:58.871 INFO:teuthology.orchestra.run.smithi089.stdout:(102/139): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-12T21:48:58.885 INFO:teuthology.orchestra.run.smithi120.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-12T21:48:58.887 INFO:teuthology.orchestra.run.smithi089.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T21:48:58.910 INFO:teuthology.orchestra.run.smithi120.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T21:48:58.912 INFO:teuthology.orchestra.run.smithi089.stdout:(104/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-12T21:48:58.930 INFO:teuthology.orchestra.run.smithi089.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 768 kB/s | 32 kB 00:00 2024-09-12T21:48:58.936 INFO:teuthology.orchestra.run.smithi120.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T21:48:58.947 INFO:teuthology.orchestra.run.smithi089.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 418 kB/s | 14 kB 00:00 2024-09-12T21:48:58.961 INFO:teuthology.orchestra.run.smithi120.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-12T21:48:58.981 INFO:teuthology.orchestra.run.smithi089.stdout:(107/139): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-12T21:48:58.986 INFO:teuthology.orchestra.run.smithi120.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T21:48:59.006 INFO:teuthology.orchestra.run.smithi089.stdout:(108/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-12T21:48:59.012 INFO:teuthology.orchestra.run.smithi120.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T21:48:59.031 INFO:teuthology.orchestra.run.smithi089.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T21:48:59.056 INFO:teuthology.orchestra.run.smithi089.stdout:(110/139): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-12T21:48:59.062 INFO:teuthology.orchestra.run.smithi120.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T21:48:59.073 INFO:teuthology.orchestra.run.smithi089.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-09-12T21:48:59.099 INFO:teuthology.orchestra.run.smithi089.stdout:(112/139): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-12T21:48:59.116 INFO:teuthology.orchestra.run.smithi089.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-12T21:48:59.133 INFO:teuthology.orchestra.run.smithi089.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-09-12T21:48:59.150 INFO:teuthology.orchestra.run.smithi089.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 576 kB/s | 19 kB 00:00 2024-09-12T21:48:59.167 INFO:teuthology.orchestra.run.smithi089.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-12T21:48:59.184 INFO:teuthology.orchestra.run.smithi089.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T21:48:59.209 INFO:teuthology.orchestra.run.smithi089.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T21:48:59.226 INFO:teuthology.orchestra.run.smithi089.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T21:48:59.260 INFO:teuthology.orchestra.run.smithi089.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-09-12T21:48:59.279 INFO:teuthology.orchestra.run.smithi120.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T21:48:59.285 INFO:teuthology.orchestra.run.smithi089.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T21:48:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-12T21:48:59.344 INFO:teuthology.orchestra.run.smithi089.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T21:48:59.369 INFO:teuthology.orchestra.run.smithi089.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-12T21:48:59.395 INFO:teuthology.orchestra.run.smithi089.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T21:48:59.420 INFO:teuthology.orchestra.run.smithi089.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T21:48:59.445 INFO:teuthology.orchestra.run.smithi089.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-12T21:48:59.479 INFO:teuthology.orchestra.run.smithi089.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T21:48:59.521 INFO:teuthology.orchestra.run.smithi089.stdout:(129/139): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-12T21:48:59.546 INFO:teuthology.orchestra.run.smithi089.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-12T21:48:59.572 INFO:teuthology.orchestra.run.smithi089.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T21:48:59.597 INFO:teuthology.orchestra.run.smithi089.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T21:48:59.622 INFO:teuthology.orchestra.run.smithi089.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T21:48:59.646 INFO:teuthology.orchestra.run.smithi120.stdout:(137/139): librbd1-19.1.1-314.g086c737f.el9.x86 5.0 MB/s | 3.2 MB 00:00 2024-09-12T21:48:59.656 INFO:teuthology.orchestra.run.smithi089.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T21:48:59.698 INFO:teuthology.orchestra.run.smithi089.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T21:48:59.788 INFO:teuthology.orchestra.run.smithi120.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-12T21:48:59.921 INFO:teuthology.orchestra.run.smithi120.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 2.4 MB 00:00 2024-09-12T21:48:59.923 INFO:teuthology.orchestra.run.smithi089.stdout:(136/139): librbd1-19.1.1-314.g086c737f.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-12T21:48:59.927 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:48:59.927 INFO:teuthology.orchestra.run.smithi120.stdout:Total 17 MB/s | 213 MB 00:12 2024-09-12T21:48:59.998 INFO:teuthology.orchestra.run.smithi089.stdout:(137/139): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-12T21:49:00.232 INFO:teuthology.orchestra.run.smithi089.stdout:(138/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-09-12T21:49:00.341 INFO:teuthology.orchestra.run.smithi089.stdout:(139/139): librados2-19.1.1-314.g086c737f.el9.x 4.8 MB/s | 3.4 MB 00:00 2024-09-12T21:49:00.347 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-12T21:49:00.347 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 213 MB 00:13 2024-09-12T21:49:00.896 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-12T21:49:01.033 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-12T21:49:01.033 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-12T21:49:01.357 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-12T21:49:01.494 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-12T21:49:01.494 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-12T21:49:02.842 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-12T21:49:02.991 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T21:49:03.127 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-12T21:49:03.128 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-12T21:49:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T21:49:03.250 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T21:49:03.291 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T21:49:03.317 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T21:49:03.368 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T21:49:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-12T21:49:03.546 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-12T21:49:03.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T21:49:03.742 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-12T21:49:03.817 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T21:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T21:49:03.959 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T21:49:03.985 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:04.005 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T21:49:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T21:49:04.077 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:04.081 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T21:49:04.116 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:04.145 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:04.250 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T21:49:04.575 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:04.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:04.712 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T21:49:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T21:49:04.831 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:04.846 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T21:49:04.865 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:04.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T21:49:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T21:49:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T21:49:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:05.031 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T21:49:05.074 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T21:49:05.105 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:05.107 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T21:49:05.133 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:05.134 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T21:49:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T21:49:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T21:49:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T21:49:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T21:49:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T21:49:05.429 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T21:49:05.459 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T21:49:05.531 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T21:49:05.572 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T21:49:05.602 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T21:49:05.653 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T21:49:05.666 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T21:49:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T21:49:05.727 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T21:49:05.735 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T21:49:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T21:49:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T21:49:05.872 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T21:49:05.901 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T21:49:05.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T21:49:05.944 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T21:49:05.977 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T21:49:06.004 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T21:49:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T21:49:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T21:49:06.163 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T21:49:06.201 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T21:49:06.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T21:49:06.312 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T21:49:06.356 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T21:49:06.383 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T21:49:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T21:49:06.457 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T21:49:06.498 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T21:49:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T21:49:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T21:49:06.576 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T21:49:06.615 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T21:49:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T21:49:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T21:49:06.719 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T21:49:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T21:49:06.876 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T21:49:06.939 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T21:49:07.003 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T21:49:07.075 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T21:49:07.115 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T21:49:07.159 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T21:49:07.207 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T21:49:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T21:49:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T21:49:07.330 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T21:49:07.415 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T21:49:07.428 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T21:49:07.458 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T21:49:07.480 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T21:49:07.501 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T21:49:07.519 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T21:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T21:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T21:49:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T21:49:07.662 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T21:49:07.712 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T21:49:07.743 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T21:49:07.752 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T21:49:07.777 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T21:49:07.800 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T21:49:07.856 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T21:49:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T21:49:07.939 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T21:49:07.976 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T21:49:08.011 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T21:49:08.012 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T21:49:08.050 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T21:49:08.059 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T21:49:08.079 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T21:49:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T21:49:08.116 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T21:49:08.146 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T21:49:08.146 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T21:49:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T21:49:08.222 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T21:49:08.263 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T21:49:08.298 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T21:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T21:49:08.356 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T21:49:08.384 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T21:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T21:49:08.428 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T21:49:08.460 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T21:49:08.503 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T21:49:08.539 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T21:49:08.580 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T21:49:08.621 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T21:49:08.654 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T21:49:08.709 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-12T21:49:08.764 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T21:49:08.774 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T21:49:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T21:49:08.844 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T21:49:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T21:49:08.893 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T21:49:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T21:49:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T21:49:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T21:49:09.022 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T21:49:09.057 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T21:49:09.090 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T21:49:09.124 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-12T21:49:09.141 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T21:49:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T21:49:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T21:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T21:49:09.253 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T21:49:09.261 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T21:49:09.298 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T21:49:09.352 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T21:49:09.385 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T21:49:09.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T21:49:09.461 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T21:49:09.475 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T21:49:09.573 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T21:49:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T21:49:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T21:49:09.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T21:49:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T21:49:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T21:49:09.662 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T21:49:09.703 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:09.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T21:49:09.772 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T21:49:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T21:49:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:09.829 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T21:49:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:09.880 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T21:49:09.928 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:09.969 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:09.972 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T21:49:09.996 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:10.005 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:10.010 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T21:49:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T21:49:10.119 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:10.155 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:10.273 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:10.306 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:10.315 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:10.401 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:10.524 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T21:49:10.583 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T21:49:10.598 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:10.625 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T21:49:10.630 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:10.659 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T21:49:10.676 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:10.697 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T21:49:10.743 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T21:49:10.746 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T21:49:10.762 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T21:49:10.801 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T21:49:10.849 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T21:49:10.858 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T21:49:10.888 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T21:49:10.894 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T21:49:10.926 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T21:49:10.984 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T21:49:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T21:49:11.015 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T21:49:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T21:49:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T21:49:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T21:49:11.102 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T21:49:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T21:49:11.147 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T21:49:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T21:49:11.184 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T21:49:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T21:49:11.218 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T21:49:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T21:49:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T21:49:11.325 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T21:49:11.328 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T21:49:11.360 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T21:49:11.364 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T21:49:11.405 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T21:49:11.408 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T21:49:11.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T21:49:11.481 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T21:49:11.484 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T21:49:11.519 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T21:49:11.551 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T21:49:11.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T21:49:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T21:49:11.604 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T21:49:11.642 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T21:49:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T21:49:11.687 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T21:49:11.706 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T21:49:11.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T21:49:11.788 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T21:49:11.792 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T21:49:11.797 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T21:49:11.841 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T21:49:11.878 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T21:49:11.921 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T21:49:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T21:49:11.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T21:49:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T21:49:12.001 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T21:49:12.076 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T21:49:12.138 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T21:49:12.211 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T21:49:12.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T21:49:12.263 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T21:49:12.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T21:49:12.298 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T21:49:12.507 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T21:49:12.595 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T21:49:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T21:49:12.633 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T21:49:12.661 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:12.668 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T21:49:12.706 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T21:49:12.752 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T21:49:12.783 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T21:49:12.791 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T21:49:12.841 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T21:49:12.875 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T21:49:12.904 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T21:49:12.918 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T21:49:12.947 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T21:49:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T21:49:12.985 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T21:49:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T21:49:13.036 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T21:49:13.094 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T21:49:13.128 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T21:49:13.163 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T21:49:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T21:49:13.218 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T21:49:13.232 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T21:49:13.255 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T21:49:13.264 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T21:49:13.306 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T21:49:13.310 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T21:49:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T21:49:13.328 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T21:49:13.341 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T21:49:13.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:13.374 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T21:49:13.383 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T21:49:13.423 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T21:49:13.427 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T21:49:13.457 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T21:49:13.467 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T21:49:13.483 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T21:49:13.514 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T21:49:13.524 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T21:49:13.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T21:49:13.602 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T21:49:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T21:49:13.658 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T21:49:13.704 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T21:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T21:49:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T21:49:13.740 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T21:49:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:13.765 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T21:49:13.779 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T21:49:13.821 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T21:49:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:13.859 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T21:49:13.883 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T21:49:13.919 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T21:49:13.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T21:49:13.962 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T21:49:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T21:49:14.012 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T21:49:14.032 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T21:49:14.044 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T21:49:14.065 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T21:49:14.069 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T21:49:14.105 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T21:49:14.135 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T21:49:14.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T21:49:14.296 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T21:49:14.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T21:49:14.344 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T21:49:14.355 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T21:49:14.379 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T21:49:14.392 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T21:49:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T21:49:14.422 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T21:49:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T21:49:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T21:49:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:14.457 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T21:49:14.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T21:49:14.527 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:14.532 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T21:49:14.541 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T21:49:14.557 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T21:49:14.575 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T21:49:14.585 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T21:49:14.633 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T21:49:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T21:49:14.714 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T21:49:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T21:49:14.745 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T21:49:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T21:49:14.848 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T21:49:14.896 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T21:49:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T21:49:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T21:49:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T21:49:15.609 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T21:49:15.671 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T21:49:15.708 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T21:49:15.778 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:15.821 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T21:49:15.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T21:49:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T21:49:15.931 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T21:49:16.001 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T21:49:16.032 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T21:49:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T21:49:16.258 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T21:49:16.289 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T21:49:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T21:49:16.379 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:16.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:16.519 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:16.519 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T21:49:16.519 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T21:49:16.519 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:16.561 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T21:49:16.784 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T21:49:17.011 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:17.038 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T21:49:17.044 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:17.154 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T21:49:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:17.754 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T21:49:17.754 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T21:49:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:17.791 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T21:49:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T21:49:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T21:49:18.193 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T21:49:18.426 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T21:49:18.503 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T21:49:18.518 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T21:49:18.546 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T21:49:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:18.579 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T21:49:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T21:49:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T21:49:18.895 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T21:49:18.943 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:19.042 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T21:49:19.072 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T21:49:19.130 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T21:49:19.206 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T21:49:19.241 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T21:49:19.615 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T21:49:19.638 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T21:49:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T21:49:21.745 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:22.057 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:22.086 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:22.446 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T21:49:22.446 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T21:49:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:22.638 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T21:49:22.684 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:22.776 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T21:49:22.776 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T21:49:22.776 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T21:49:22.776 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:22.811 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:28.324 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:28.324 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-12T21:49:28.324 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-12T21:49:28.324 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-12T21:49:28.324 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-12T21:49:28.325 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-12T21:49:28.325 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-12T21:49:28.325 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-12T21:49:28.325 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:28.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:28.519 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:28.519 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:28.519 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T21:49:28.519 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:30.022 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:30.049 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:30.049 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:30.050 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T21:49:30.050 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:30.050 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:30.050 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:30.076 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:30.076 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-09-12T21:49:30.077 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:30.251 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:30.267 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:30.267 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:30.268 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T21:49:30.268 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:30.289 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:30.313 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:30.313 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:30.313 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T21:49:30.313 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:30.314 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:30.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:30.749 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:30.772 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:30.772 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:30.772 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T21:49:30.772 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:30.772 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:30.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T21:49:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T21:49:30.982 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T21:49:31.178 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T21:49:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T21:49:31.327 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T21:49:31.415 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T21:49:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T21:49:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T21:49:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T21:49:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T21:49:31.811 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:31.839 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T21:49:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:31.840 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:32.088 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:32.113 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:32.163 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:32.190 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:32.222 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T21:49:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T21:49:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:32.573 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:32.598 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:32.704 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T21:49:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T21:49:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T21:49:33.026 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T21:49:33.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T21:49:33.170 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T21:49:33.268 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T21:49:33.365 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:33.407 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T21:49:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T21:49:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T21:49:33.516 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T21:49:33.905 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:33.939 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:33.971 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T21:49:34.036 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T21:49:34.062 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:34.512 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-09-12T21:49:34.557 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-09-12T21:49:34.558 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-09-12T21:49:34.558 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-09-12T21:49:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:34.686 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T21:49:34.694 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T21:49:34.694 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-12T21:49:34.694 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-12T21:49:34.695 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:34.718 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:34.736 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:34.741 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:34.742 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:34.742 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T21:49:34.742 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:34.742 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:34.742 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:34.755 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:34.755 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:34.755 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T21:49:34.755 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:34.793 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:34.805 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:34.867 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:34.883 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T21:49:34.883 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:34.883 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T21:49:34.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:34.903 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T21:49:34.965 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T21:49:35.162 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:35.206 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:35.891 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T21:49:35.921 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:35.945 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:35.988 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:36.011 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:36.011 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.011 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T21:49:36.011 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:36.221 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:36.248 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:36.314 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:36.340 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.341 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T21:49:36.341 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:36.341 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:36.355 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T21:49:36.423 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.423 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T21:49:36.423 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:36.423 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T21:49:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:36.491 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:36.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T21:49:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:36.575 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.576 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T21:49:36.576 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:36.576 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:36.646 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T21:49:36.670 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:36.739 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T21:49:36.802 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T21:49:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:36.964 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:36.964 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T21:49:36.964 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:36.964 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:37.088 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T21:49:37.114 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T21:49:37.137 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T21:49:37.137 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:37.137 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T21:49:37.137 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:37.138 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T21:49:37.138 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T21:49:37.261 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T21:49:37.318 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T21:49:37.374 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T21:49:37.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T21:49:37.426 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T21:49:37.503 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T21:49:37.565 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T21:49:37.591 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T21:49:37.615 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T21:49:37.693 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T21:49:37.730 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T21:49:37.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T21:49:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T21:49:37.790 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T21:49:37.811 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:37.816 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T21:49:37.836 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:37.837 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:37.837 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T21:49:37.837 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:37.837 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:37.837 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:37.844 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T21:49:37.878 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:37.903 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:37.903 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:37.903 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T21:49:37.903 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:37.931 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T21:49:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T21:49:38.014 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T21:49:38.042 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T21:49:38.220 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:38.245 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:38.245 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:38.246 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T21:49:38.246 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:38.246 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:38.246 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:38.291 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:38.319 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:38.350 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T21:49:38.412 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T21:49:38.442 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T21:49:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T21:49:38.636 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T21:49:38.664 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:39.477 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:39.519 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:39.704 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T21:49:39.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:40.475 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:40.694 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T21:49:40.725 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T21:49:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:40.828 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T21:49:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:40.836 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:40.836 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T21:49:40.836 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:40.836 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:40.959 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T21:49:40.988 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T21:49:40.988 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T21:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T21:49:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T21:49:41.043 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T21:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T21:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T21:49:41.095 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:41.106 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T21:49:41.107 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T21:49:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T21:49:41.271 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T21:49:41.952 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T21:49:41.981 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T21:49:42.008 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:42.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:42.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T21:49:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:42.098 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.098 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T21:49:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:42.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T21:49:42.198 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T21:49:42.231 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:42.234 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T21:49:42.255 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:42.270 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T21:49:42.299 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:42.304 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T21:49:42.304 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:42.321 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T21:49:42.322 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.322 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T21:49:42.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:42.388 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:42.409 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:42.432 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:42.473 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:42.545 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:42.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T21:49:42.647 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T21:49:42.648 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T21:49:42.648 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:42.648 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T21:49:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:43.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T21:49:43.133 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T21:49:43.174 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T21:49:43.205 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T21:49:43.231 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T21:49:44.125 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T21:49:44.215 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T21:49:44.280 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T21:49:44.399 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T21:49:44.435 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T21:49:44.469 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T21:49:44.469 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:44.536 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:44.536 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:44.627 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:44.697 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T21:49:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T21:49:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T21:49:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T21:49:47.129 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T21:49:47.328 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T21:49:47.378 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T21:49:47.419 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T21:49:47.459 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T21:49:47.486 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T21:49:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T21:49:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T21:49:48.060 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:48.060 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:48.061 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T21:49:48.062 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T21:49:48.063 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T21:49:48.073 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T21:49:48.074 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T21:49:48.075 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T21:49:48.076 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T21:49:48.077 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T21:49:48.078 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T21:49:48.079 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T21:49:48.080 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T21:49:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T21:49:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T21:49:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T21:49:48.199 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T21:49:48.227 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T21:49:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T21:49:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T21:49:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T21:49:48.422 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:48.444 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T21:49:48.502 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:48.548 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T21:49:48.584 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T21:49:48.621 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T21:49:48.621 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T21:49:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:48.771 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T21:49:48.834 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:49.995 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:49.995 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T21:49:49.996 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T21:49:49.997 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T21:49:49.997 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T21:49:49.997 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T21:49:49.997 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T21:49:49.997 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T21:49:49.998 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T21:49:49.998 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T21:49:49.998 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T21:49:49.998 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T21:49:49.999 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T21:49:49.999 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T21:49:49.999 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T21:49:49.999 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T21:49:49.999 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T21:49:50.000 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T21:49:50.000 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T21:49:50.014 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T21:49:50.015 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T21:49:50.016 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T21:49:50.017 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T21:49:50.018 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T21:49:50.019 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T21:49:50.020 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T21:49:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T21:49:50.022 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T21:49:50.023 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-12T21:49:50.604 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.605 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.606 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.607 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.608 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T21:49:50.609 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T21:49:50.610 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T21:49:50.611 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T21:49:50.612 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T21:49:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T21:49:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T21:49:50.616 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T21:49:50.616 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T21:49:50.616 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:49:50.616 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-12T21:49:50.956 DEBUG:teuthology.parallel:result is None 2024-09-12T21:49:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T21:49:52.339 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T21:49:52.340 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T21:49:52.341 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T21:49:52.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T21:49:52.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T21:49:52.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T21:49:52.345 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T21:49:52.346 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T21:49:52.347 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T21:49:52.348 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T21:49:52.349 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T21:49:52.349 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:49:52.349 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-12T21:49:52.837 DEBUG:teuthology.parallel:result is None 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T21:49:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T21:49:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T21:49:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T21:49:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T21:49:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T21:49:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T21:49:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T21:49:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T21:49:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T21:49:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T21:49:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T21:49:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T21:49:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T21:49:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T21:49:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T21:49:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T21:49:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T21:49:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T21:49:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T21:49:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T21:49:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T21:49:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T21:49:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T21:49:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T21:49:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T21:49:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T21:49:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T21:49:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T21:49:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T21:49:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T21:49:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T21:49:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T21:49:54.412 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:54.412 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T21:49:54.412 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T21:49:54.412 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T21:49:54.413 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T21:49:54.414 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T21:49:54.415 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T21:49:54.415 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T21:49:54.415 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T21:49:54.415 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T21:49:54.415 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T21:49:54.425 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T21:49:54.425 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T21:49:54.425 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T21:49:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T21:49:54.427 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T21:49:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T21:49:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T21:49:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T21:49:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T21:49:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T21:49:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T21:49:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T21:49:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T21:49:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T21:49:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T21:49:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T21:49:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T21:49:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T21:49:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T21:49:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T21:49:54.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T21:49:54.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T21:49:54.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T21:49:54.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T21:49:54.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T21:49:54.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T21:49:56.233 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:56.233 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.234 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.235 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T21:49:56.236 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T21:49:56.237 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T21:49:56.238 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T21:49:56.239 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T21:49:56.240 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:56.241 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T21:49:56.242 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T21:49:56.243 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T21:49:56.244 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T21:49:56.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:49:56.245 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-12T21:49:56.598 DEBUG:teuthology.parallel:result is None 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-12T21:49:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T21:49:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T21:49:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T21:49:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T21:49:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T21:49:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T21:49:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T21:49:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T21:49:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T21:49:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T21:49:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T21:49:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T21:49:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T21:49:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T21:49:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:49:57.038 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-12T21:49:57.394 DEBUG:teuthology.parallel:result is None 2024-09-12T21:49:57.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:49:57.540 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T21:49:57.568 INFO:teuthology.orchestra.run.smithi053.stdout:19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.568 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.568 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T21:49:57.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:49:57.713 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T21:49:57.736 INFO:teuthology.orchestra.run.smithi089.stdout:19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.736 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.736 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T21:49:57.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:49:57.872 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T21:49:57.898 INFO:teuthology.orchestra.run.smithi120.stdout:19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.898 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T21:49:57.899 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T21:49:57.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:49:58.040 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T21:49:58.068 INFO:teuthology.orchestra.run.smithi172.stdout:19.1.1-314.g086c737f.el9 2024-09-12T21:49:58.068 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T21:49:58.068 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T21:49:58.070 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T21:49:58.071 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:49:58.071 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T21:49:58.106 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:49:58.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T21:49:58.138 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:49:58.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T21:49:58.171 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:49:58.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T21:49:58.204 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T21:49:58.204 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:49:58.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T21:49:58.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T21:49:58.304 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:49:58.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T21:49:58.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T21:49:58.402 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:49:58.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T21:49:58.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T21:49:58.501 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:49:58.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T21:49:58.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T21:49:58.602 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T21:49:58.602 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:49:58.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T21:49:58.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T21:49:58.704 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:49:58.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T21:49:58.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T21:49:58.802 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:49:58.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T21:49:58.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T21:49:58.900 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:49:58.900 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T21:49:58.929 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T21:49:58.998 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T21:49:58.999 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:49:58.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T21:49:59.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T21:49:59.100 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:49:59.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T21:49:59.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T21:49:59.199 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:49:59.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T21:49:59.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T21:49:59.300 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:49:59.300 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T21:49:59.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T21:49:59.398 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T21:49:59.480 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T21:49:59.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-09-12T21:49:59.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-09-12T21:49:59.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-12T21:49:59.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-09-12T21:49:59.518 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T21:49:59.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T21:49:59.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T21:49:59.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T21:49:59.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T21:49:59.589 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T21:49:59.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T21:49:59.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T21:49:59.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T21:49:59.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T21:49:59.669 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T21:49:59.670 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T21:49:59.670 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7902901', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8861, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbYlzzASSsQQfsDr/xOQOkJ2Hnwxq1B+bKCoW++LkvNggM7WTHbQQJPDUQ6DLqj+ZjiGaTQCGjlK5kuQGbo2EM=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGmqVRuhnvhBFgLsve5A1/1bVG0HywbH58EFKjI/67apoS0Nz3BGowuxAJxfRlQ+neqnx+vFLLtht7HJ7mhG8r0=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIqx+gvyzbTnXy3gykliS0At80Yk4yOle6IOl5w1lBdxOzBvLV/opwKd/9TDUUUKieYj3WKuuuAEiIDgQGF7ec0=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGG1JgXrVV2FDqTI9xm8uwpOusMtEe72ge7LWATOwWVwQL7ZQRYnu5IT71EMnIAaAASBAfPBEPYDueEo0ya9qcE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T21:49:59.670 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T21:49:59.692 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T21:49:59.695 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T21:49:59.697 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T21:49:59.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:49:59.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:49:59.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:49:59.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:49:59.788 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:49:59.788 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T21:49:59.833 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T21:49:59.834 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-12T21:49:59.890 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T21:49:59.890 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:49:59.890 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-12 21:49:49.191162563 +0000 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-12 21:47:54.325779266 +0000 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-12 21:47:54.325779266 +0000 2024-09-12T21:49:59.891 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-12 21:47:54.325779266 +0000 2024-09-12T21:49:59.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T21:49:59.955 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-12T21:49:59.955 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-12T21:49:59.956 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000211767 s, 2.4 MB/s 2024-09-12T21:49:59.957 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T21:50:00.014 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-12 21:49:49.192162540 +0000 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-12 21:47:54.643772117 +0000 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-12 21:47:54.643772117 +0000 2024-09-12T21:50:00.071 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-12 21:47:54.643772117 +0000 2024-09-12T21:50:00.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T21:50:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-12T21:50:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-12T21:50:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000227414 s, 2.3 MB/s 2024-09-12T21:50:00.137 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T21:50:00.194 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-12T21:50:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T21:50:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-12 21:49:49.192162540 +0000 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-12 21:47:54.956765080 +0000 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-12 21:47:54.956765080 +0000 2024-09-12T21:50:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-12 21:47:54.956765080 +0000 2024-09-12T21:50:00.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T21:50:00.315 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-12T21:50:00.315 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-12T21:50:00.315 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.0002157 s, 2.4 MB/s 2024-09-12T21:50:00.316 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T21:50:00.373 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.428 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-12 21:49:49.192162540 +0000 2024-09-12T21:50:00.429 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-12 21:47:55.267758090 +0000 2024-09-12T21:50:00.429 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-12 21:47:55.267758090 +0000 2024-09-12T21:50:00.429 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-12 21:47:55.267758090 +0000 2024-09-12T21:50:00.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T21:50:00.491 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-12T21:50:00.492 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-12T21:50:00.492 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00015709 s, 3.3 MB/s 2024-09-12T21:50:00.493 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T21:50:00.549 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:00.549 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:50:00.549 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T21:50:00.568 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T21:50:00.569 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-12T21:50:00.627 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 21:49:48.872476756 +0000 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 21:47:58.599856519 +0000 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 21:47:58.599856519 +0000 2024-09-12T21:50:00.628 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 21:47:58.599856519 +0000 2024-09-12T21:50:00.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T21:50:00.697 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T21:50:00.697 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T21:50:00.697 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000222281 s, 2.3 MB/s 2024-09-12T21:50:00.698 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T21:50:00.756 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 21:49:48.873476733 +0000 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 21:47:58.932849271 +0000 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 21:47:58.932849271 +0000 2024-09-12T21:50:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 21:47:58.932849271 +0000 2024-09-12T21:50:00.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T21:50:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T21:50:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T21:50:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000248585 s, 2.1 MB/s 2024-09-12T21:50:00.881 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T21:50:00.939 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-12T21:50:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T21:50:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:00.995 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 21:49:48.873476733 +0000 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 21:47:59.265842023 +0000 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 21:47:59.265842023 +0000 2024-09-12T21:50:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 21:47:59.265842023 +0000 2024-09-12T21:50:00.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T21:50:01.060 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T21:50:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T21:50:01.061 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00024612 s, 2.1 MB/s 2024-09-12T21:50:01.062 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T21:50:01.119 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 21:49:48.874476711 +0000 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 21:47:59.587835015 +0000 2024-09-12T21:50:01.175 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 21:47:59.587835015 +0000 2024-09-12T21:50:01.176 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 21:47:59.587835015 +0000 2024-09-12T21:50:01.176 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T21:50:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T21:50:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T21:50:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000234784 s, 2.2 MB/s 2024-09-12T21:50:01.241 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T21:50:01.297 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:01.298 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:50:01.298 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T21:50:01.317 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T21:50:01.318 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-12T21:50:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 21:49:42.909705610 +0000 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 21:47:57.543158110 +0000 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 21:47:57.543158110 +0000 2024-09-12T21:50:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 21:47:57.543158110 +0000 2024-09-12T21:50:01.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T21:50:01.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T21:50:01.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T21:50:01.445 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000280252 s, 1.8 MB/s 2024-09-12T21:50:01.446 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T21:50:01.506 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-12T21:50:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T21:50:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 21:49:42.910705586 +0000 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 21:47:57.876150153 +0000 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 21:47:57.876150153 +0000 2024-09-12T21:50:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 21:47:57.876150153 +0000 2024-09-12T21:50:01.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T21:50:01.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T21:50:01.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T21:50:01.631 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000190306 s, 2.7 MB/s 2024-09-12T21:50:01.632 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T21:50:01.689 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-12T21:50:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 21:49:42.910705586 +0000 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 21:47:58.202142363 +0000 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 21:47:58.202142363 +0000 2024-09-12T21:50:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 21:47:58.202142363 +0000 2024-09-12T21:50:01.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T21:50:01.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T21:50:01.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T21:50:01.813 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000189251 s, 2.7 MB/s 2024-09-12T21:50:01.814 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T21:50:01.871 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-12T21:50:01.929 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T21:50:01.929 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T21:50:01.929 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 21:49:42.910705586 +0000 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 21:47:58.553133976 +0000 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 21:47:58.553133976 +0000 2024-09-12T21:50:01.930 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 21:47:58.553133976 +0000 2024-09-12T21:50:01.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T21:50:01.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T21:50:01.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T21:50:01.995 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000232044 s, 2.2 MB/s 2024-09-12T21:50:01.996 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T21:50:02.053 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:02.053 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T21:50:02.053 INFO:tasks.ceph:Generating config... 2024-09-12T21:50:02.054 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T21:50:02.055 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T21:50:02.055 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T21:50:02.055 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T21:50:02.055 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T21:50:02.055 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T21:50:02.055 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T21:50:02.056 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T21:50:02.056 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T21:50:02.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T21:50:02.125 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T21:50:02.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T21:50:02.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T21:50:02.204 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]'), ('mon.c', '[v2:172.21.15.53:3302,v1:172.21.15.53:6791]')] 2024-09-12T21:50:02.204 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-12T21:50:02.205 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:02.205 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T21:50:02.261 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --addv b '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]' --addv c '[v2:172.21.15.53:3302,v1:172.21.15.53:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:02.349 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-09-12T21:50:02.349314+0000 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-12T21:50:02.349314+0000 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon.b 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.53:3302/0,v1:172.21.15.53:6791/0] mon.c 2024-09-12T21:50:02.350 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T21:50:02.352 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T21:50:02.367 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6... 2024-09-12T21:50:02.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T21:50:02.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T21:50:02.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T21:50:02.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.453 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.454 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-09-12T21:50:02.455 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-09-12T21:50:02.456 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]" 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-09-12T21:50:02.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.458 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-09-12T21:50:02.459 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd blocked scrub grace period = 3600 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd max markdown count = 1000 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-09-12T21:50:02.460 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-12T21:50:02.461 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T21:50:02.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2024-09-12T21:50:02.463 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2024-09-12T21:50:02.464 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-09-12T21:50:02.464 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-12T21:50:02.464 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-09-12T21:50:02.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.466 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T21:50:02.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]" 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-09-12T21:50:02.468 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-09-12T21:50:02.470 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-09-12T21:50:02.471 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd max markdown count = 1000 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-09-12T21:50:02.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T21:50:02.473 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-09-12T21:50:02.474 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-12T21:50:02.475 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.476 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-12T21:50:02.477 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-12T21:50:02.478 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]" 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-12T21:50:02.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-12T21:50:02.480 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-12T21:50:02.481 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: osd max markdown count = 1000 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.482 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-12T21:50:02.483 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T21:50:02.484 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T21:50:02.485 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.486 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.487 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T21:50:02.488 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]" 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:02.489 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-09-12T21:50:02.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-09-12T21:50:02.491 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-09-12T21:50:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: osd max markdown count = 1000 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-12T21:50:02.493 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-09-12T21:50:02.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.495 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-12T21:50:02.496 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T21:50:02.499 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T21:50:02.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T21:50:02.594 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T21:50:02.594 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:02.594 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T21:50:02.610 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:02.610 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T21:50:02.665 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-09-12T21:50:02.665 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:02.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T21:50:02.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T21:50:02.741 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:02.741 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:02.797 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:50:02.797 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:50:02.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T21:50:02.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T21:50:02.839 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:50:02.839 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:02.897 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T21:50:02.897 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:50:02.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T21:50:02.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T21:50:02.938 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:50:02.938 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:02.996 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:50:02.996 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:50:02.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T21:50:02.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T21:50:03.038 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:50:03.038 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:03.096 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T21:50:03.096 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T21:50:03.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T21:50:03.151 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T21:50:03.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T21:50:03.205 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T21:50:03.208 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T21:50:03.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T21:50:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T21:50:03.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T21:50:03.289 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T21:50:03.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T21:50:03.371 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T21:50:03.384 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T21:50:03.384 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T21:50:03.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T21:50:03.414 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:03.414 INFO:tasks.ceph:role: osd.0 2024-09-12T21:50:03.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:50:03.414 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T21:50:03.491 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T21:50:03.491 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T21:50:03.491 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T21:50:03.491 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T21:50:03.491 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T21:50:03.492 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-12T21:50:03.492 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T21:50:03.492 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T21:50:03.492 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T21:50:03.492 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T21:50:03.998 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-12T21:50:04.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-12T21:50:04.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T21:50:04.124 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T21:50:04.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:04.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-12T21:50:04.263+0000 7f59ff751640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T21:50:04.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-12T21:50:04.265+0000 7f59ff751640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T21:50:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-12T21:50:04.265+0000 7f59ff751640 -1 bdev(0x56101b78f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T21:50:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-12T21:50:04.265+0000 7f59ff751640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T21:50:08.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T21:50:08.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T21:50:08.251 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:08.251 INFO:tasks.ceph:role: osd.1 2024-09-12T21:50:08.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T21:50:08.252 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T21:50:08.327 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T21:50:08.328 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T21:50:08.328 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T21:50:08.328 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T21:50:08.328 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T21:50:08.328 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-12T21:50:08.329 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T21:50:08.329 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T21:50:08.329 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T21:50:08.329 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T21:50:08.825 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-12T21:50:08.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-12T21:50:08.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T21:50:08.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T21:50:08.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:09.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T21:50:09.120+0000 7efd0ee17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T21:50:09.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T21:50:09.122+0000 7efd0ee17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T21:50:09.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T21:50:09.122+0000 7efd0ee17640 -1 bdev(0x55916c0c5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T21:50:09.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T21:50:09.122+0000 7efd0ee17640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T21:50:12.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T21:50:12.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T21:50:12.853 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T21:50:12.853 INFO:tasks.ceph:role: osd.2 2024-09-12T21:50:12.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:50:12.854 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T21:50:12.930 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T21:50:12.931 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T21:50:13.445 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-12T21:50:13.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-12T21:50:13.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T21:50:13.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T21:50:13.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:13.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T21:50:13.683+0000 7fcbc660e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T21:50:13.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T21:50:13.686+0000 7fcbc660e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T21:50:13.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T21:50:13.686+0000 7fcbc660e640 -1 bdev(0x55967ab05800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T21:50:13.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T21:50:13.686+0000 7fcbc660e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T21:50:16.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T21:50:16.890 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T21:50:16.890 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:16.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T21:50:16.921 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:16.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T21:50:16.991 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:16.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T21:50:17.061 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:50:17.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T21:50:17.091 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:50:17.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T21:50:17.122 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:50:17.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T21:50:17.152 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-12T21:50:17.152 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T21:50:17.170 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T21:50:17.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T21:50:17.238 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQALYuNmq3n8CBAAXWRmbMeD6+IV7hpoufqNLQ== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQALYuNm8GpDDBAAnqYrQN4vYWMYtyb0O3bOjw== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQALYuNmeGePDxAAbwH1Yt/wA7ZHQ/yYy7tz8w== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAMYuNm1T7PDxAAax10f3AEZ8OZ7qtQIRFUow== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQARYuNmRRFDBxAAQmRgvgRDAyMtPXoJKTtTBQ== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAVYuNm6zDhKBAAdrSzbyCbHIk5Gf+KsUcTPQ== 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-12T21:50:17.239 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQALYuNm5tkaFhAAhLCAI42gF7RmJ2BRz9AaZg== 2024-09-12T21:50:17.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T21:50:17.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T21:50:17.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T21:50:17.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T21:50:17.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T21:50:17.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T21:50:17.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T21:50:17.660 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T21:50:17.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T21:50:17.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T21:50:17.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T21:50:17.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T21:50:17.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T21:50:17.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T21:50:18.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T21:50:18.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T21:50:18.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T21:50:18.188 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T21:50:18.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T21:50:18.245 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T21:50:18.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T21:50:18.287 INFO:tasks.ceph.mon.a:Started 2024-09-12T21:50:18.287 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T21:50:18.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T21:50:18.290 INFO:tasks.ceph.mon.b:Started 2024-09-12T21:50:18.290 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T21:50:18.290 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T21:50:18.292 INFO:tasks.ceph.mon.c:Started 2024-09-12T21:50:18.292 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T21:50:18.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T21:50:18.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T21:50:18.295 INFO:tasks.ceph.mgr.x:Started 2024-09-12T21:50:18.295 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T21:50:18.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T21:50:18.297 INFO:tasks.ceph.mgr.y:Started 2024-09-12T21:50:18.297 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T21:50:18.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T21:50:18.711 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-12T21:50:18.727 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T21:50:18.727 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T21:50:18.727 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-12T21:50:18.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T21:50:18.729 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:18.727+0000 7fbdfc320040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T21:50:18.730 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:18.729+0000 7f2a6e60e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T21:50:18.757 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T21:50:18.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T21:50:18.773 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:18.771+0000 7fbdfc320040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T21:50:18.773 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:18.771+0000 7f2a6e60e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T21:50:18.786 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T21:50:18.786 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T21:50:18.816 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 4d630dcc-ee37-4038-813b-4830ab592c6c 0 2024-09-12T21:50:18.926 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:18.924+0000 7f2a6e60e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T21:50:18.926 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:18.924+0000 7fbdfc320040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T21:50:18.979 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:18.978+0000 7f2a6e60e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T21:50:18.980 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:18.978+0000 7fbdfc320040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T21:50:19.041 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-09-12T21:50:19.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 671f6920-54e5-4839-ad7e-ca44ff87ceb9 1 2024-09-12T21:50:19.151 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:19.149+0000 7f2a6e60e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T21:50:19.151 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:19.150+0000 7fbdfc320040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T21:50:19.228 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-09-12T21:50:19.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new e46b482a-7d0d-48a5-a625-9f8a31045bf3 2 2024-09-12T21:50:19.270 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:19.268+0000 7fbdfc320040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T21:50:19.270 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:19.268+0000 7f2a6e60e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T21:50:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-09-12T21:50:19.425 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T21:50:19.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T21:50:19.427 INFO:tasks.ceph.osd.0:Started 2024-09-12T21:50:19.428 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T21:50:19.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T21:50:19.430 INFO:tasks.ceph.osd.1:Started 2024-09-12T21:50:19.431 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T21:50:19.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T21:50:19.433 INFO:tasks.ceph.osd.2:Started 2024-09-12T21:50:19.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:19.606 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:19.606 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:19.412280+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:19.618 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T21:50:19.618 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T21:50:19.619 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:19.616+0000 7f2a6e60e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T21:50:19.619 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:19.616+0000 7fbdfc320040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T21:50:19.672 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:19.670+0000 7f2a6e60e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T21:50:19.672 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:19.670+0000 7fbdfc320040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T21:50:19.832 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:19.830+0000 7f2a6e60e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T21:50:19.832 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:19.830+0000 7fbdfc320040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T21:50:19.921 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:20.085 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-12T21:50:20.085 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":5,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:19.412280+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:20.095 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T21:50:20.833 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:20.831+0000 7f2a6e60e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T21:50:20.834 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:20.831+0000 7fbdfc320040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T21:50:20.889 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:20.887+0000 7f2a6e60e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T21:50:20.890 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:20.887+0000 7fbdfc320040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T21:50:21.100 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:21.098+0000 7f243861e640 -1 Falling back to public interface 2024-09-12T21:50:21.282 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.281+0000 7fbdfc320040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T21:50:21.283 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.281+0000 7f2a6e60e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T21:50:21.334 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:21.334+0000 7efec1c0c640 -1 Falling back to public interface 2024-09-12T21:50:21.335 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:21.334+0000 7f093afae640 -1 Falling back to public interface 2024-09-12T21:50:21.373 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.371+0000 7fbdfc320040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T21:50:21.373 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.371+0000 7f2a6e60e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T21:50:21.486 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.484+0000 7fbdfc320040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T21:50:21.486 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.484+0000 7f2a6e60e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T21:50:21.535 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.533+0000 7fbdfc320040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T21:50:21.535 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.533+0000 7f2a6e60e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T21:50:21.655 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.653+0000 7fbdfc320040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T21:50:21.655 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.653+0000 7f2a6e60e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T21:50:21.711 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.710+0000 7f2a6e60e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T21:50:21.712 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.710+0000 7fbdfc320040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T21:50:21.759 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.757+0000 7f2a6e60e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T21:50:21.760 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.757+0000 7fbdfc320040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T21:50:21.878 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.876+0000 7fbdfc320040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T21:50:21.878 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.876+0000 7f2a6e60e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T21:50:21.931 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.929+0000 7f2a6e60e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T21:50:21.931 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.929+0000 7fbdfc320040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T21:50:21.986 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:21.984+0000 7f2a6e60e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T21:50:21.986 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:21.984+0000 7fbdfc320040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T21:50:22.057 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:22.056+0000 7f2a6e60e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T21:50:22.058 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:22.056+0000 7fbdfc320040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T21:50:22.105 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:22.103+0000 7f2a6e60e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T21:50:22.105 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:22.103+0000 7fbdfc320040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T21:50:22.152 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:22.150+0000 7f2a6e60e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T21:50:22.152 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:22.150+0000 7fbdfc320040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T21:50:22.847 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-12T21:50:22.845+0000 7fbdfc320040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T21:50:22.848 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:22.845+0000 7f2a6e60e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T21:50:23.864 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:23.862+0000 7f2a0e2f6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T21:50:23.864 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-09-12T21:50:23.862+0000 7f2a0e2f6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T21:50:25.077 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:25.075+0000 7efec1c0c640 -1 osd.0 0 log_to_monitors true 2024-09-12T21:50:25.574 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:25.572+0000 7f243861e640 -1 osd.1 0 log_to_monitors true 2024-09-12T21:50:25.828 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:25.827+0000 7f093afae640 -1 osd.2 0 log_to_monitors true 2024-09-12T21:50:26.397 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:26.689 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-12T21:50:26.689 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":6,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:25.860569+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:26.700 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T21:50:27.694 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:27.692+0000 7f2434872640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T21:50:27.708 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:27.707+0000 7f242be6d640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T21:50:27.712 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:27.711+0000 7f093671a640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T21:50:27.713 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:27.712+0000 7efebcda5640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T21:50:27.722 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:27.721+0000 7f092ed4c640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T21:50:27.726 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:27.726+0000 7efeb53d7640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T21:50:33.003 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:33.297 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-12T21:50:33.297 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":11,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:31.698860+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:33.308 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T21:50:33.308 INFO:tasks.ceph:Creating RBD pool 2024-09-12T21:50:33.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T21:50:33.711 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-09-12T21:50:33.724 DEBUG:teuthology.orchestra.run.smithi053:> rbd --cluster ceph pool init rbd 2024-09-12T21:50:36.737 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T21:50:36.737 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T21:50:36.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T21:50:36.740 INFO:tasks.ceph.mds.a:Started 2024-09-12T21:50:36.740 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T21:50:36.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:50:36.823 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-12T21:50:37.073 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:37.073 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":2,"btime":"2024-09-12T21:50:36:826029+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T21:50:37.073 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 2 2024-09-12T21:50:37.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T21:50:37.377 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:37.377 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-12T21:50:37.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:37.377 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-12T21:50:37.377 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:37.378 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-12T21:50:37.390 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T21:50:37.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T21:50:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-12T21:50:37.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T21:50:38.842 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-12T21:50:38.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T21:50:39.846 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T21:50:39.865 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:40.162 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:39.196087+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:40.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:40.469 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:39.196087+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:40.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T21:50:40.861 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T21:50:40.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T21:50:41.832 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-12T21:50:41.831+0000 7f32b80bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T21:50:41.869 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T21:50:41.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:50:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:50:42.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:42.504 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:42.504 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:40.842941+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:42.518 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T21:50:42.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T21:50:40.856722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86840,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028680,"statfs":{"total":289910292480,"available":289821368320,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000641"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842572+0000","last_change":"2024-09-12T21:50:38.842572+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842572+0000","last_undegraded":"2024-09-12T21:50:38.842572+0000","last_fullsized":"2024-09-12T21:50:38.842572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842829+0000","last_change":"2024-09-12T21:50:38.842829+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842829+0000","last_undegraded":"2024-09-12T21:50:38.842829+0000","last_fullsized":"2024-09-12T21:50:38.842829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844581+0000","last_change":"2024-09-12T21:50:38.844581+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844581+0000","last_undegraded":"2024-09-12T21:50:38.844581+0000","last_fullsized":"2024-09-12T21:50:38.844581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840148+0000","last_change":"2024-09-12T21:50:38.840148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840148+0000","last_undegraded":"2024-09-12T21:50:38.840148+0000","last_fullsized":"2024-09-12T21:50:38.840148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844355+0000","last_change":"2024-09-12T21:50:38.844355+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844355+0000","last_undegraded":"2024-09-12T21:50:38.844355+0000","last_fullsized":"2024-09-12T21:50:38.844355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843802+0000","last_change":"2024-09-12T21:50:38.843802+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843802+0000","last_undegraded":"2024-09-12T21:50:38.843802+0000","last_fullsized":"2024-09-12T21:50:38.843802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844006+0000","last_change":"2024-09-12T21:50:38.844006+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844006+0000","last_undegraded":"2024-09-12T21:50:38.844006+0000","last_fullsized":"2024-09-12T21:50:38.844006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842159+0000","last_change":"2024-09-12T21:50:38.842159+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842159+0000","last_undegraded":"2024-09-12T21:50:38.842159+0000","last_fullsized":"2024-09-12T21:50:38.842159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843798+0000","last_change":"2024-09-12T21:50:38.843798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843798+0000","last_undegraded":"2024-09-12T21:50:38.843798+0000","last_fullsized":"2024-09-12T21:50:38.843798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842820+0000","last_change":"2024-09-12T21:50:38.842820+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842820+0000","last_undegraded":"2024-09-12T21:50:38.842820+0000","last_fullsized":"2024-09-12T21:50:38.842820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842445+0000","last_change":"2024-09-12T21:50:38.842445+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842445+0000","last_undegraded":"2024-09-12T21:50:38.842445+0000","last_fullsized":"2024-09-12T21:50:38.842445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842767+0000","last_change":"2024-09-12T21:50:38.842767+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842767+0000","last_undegraded":"2024-09-12T21:50:38.842767+0000","last_fullsized":"2024-09-12T21:50:38.842767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842539+0000","last_change":"2024-09-12T21:50:38.842539+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842539+0000","last_undegraded":"2024-09-12T21:50:38.842539+0000","last_fullsized":"2024-09-12T21:50:38.842539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843210+0000","last_change":"2024-09-12T21:50:38.843210+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843210+0000","last_undegraded":"2024-09-12T21:50:38.843210+0000","last_fullsized":"2024-09-12T21:50:38.843210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844148+0000","last_change":"2024-09-12T21:50:38.844148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844148+0000","last_undegraded":"2024-09-12T21:50:38.844148+0000","last_fullsized":"2024-09-12T21:50:38.844148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840296+0000","last_change":"2024-09-12T21:50:38.840296+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840296+0000","last_undegraded":"2024-09-12T21:50:38.840296+0000","last_fullsized":"2024-09-12T21:50:38.840296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844191+0000","last_change":"2024-09-12T21:50:38.844191+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844191+0000","last_undegraded":"2024-09-12T21:50:38.844191+0000","last_fullsized":"2024-09-12T21:50:38.844191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842890+0000","last_change":"2024-09-12T21:50:38.842890+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842890+0000","last_undegraded":"2024-09-12T21:50:38.842890+0000","last_fullsized":"2024-09-12T21:50:38.842890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843166+0000","last_change":"2024-09-12T21:50:38.843166+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843166+0000","last_undegraded":"2024-09-12T21:50:38.843166+0000","last_fullsized":"2024-09-12T21:50:38.843166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842052+0000","last_change":"2024-09-12T21:50:38.842052+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842052+0000","last_undegraded":"2024-09-12T21:50:38.842052+0000","last_fullsized":"2024-09-12T21:50:38.842052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844005+0000","last_change":"2024-09-12T21:50:38.844005+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844005+0000","last_undegraded":"2024-09-12T21:50:38.844005+0000","last_fullsized":"2024-09-12T21:50:38.844005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841746+0000","last_change":"2024-09-12T21:50:38.841746+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841746+0000","last_undegraded":"2024-09-12T21:50:38.841746+0000","last_fullsized":"2024-09-12T21:50:38.841746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841278+0000","last_change":"2024-09-12T21:50:38.841278+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841278+0000","last_undegraded":"2024-09-12T21:50:38.841278+0000","last_fullsized":"2024-09-12T21:50:38.841278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843985+0000","last_change":"2024-09-12T21:50:38.843985+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843985+0000","last_undegraded":"2024-09-12T21:50:38.843985+0000","last_fullsized":"2024-09-12T21:50:38.843985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843280+0000","last_change":"2024-09-12T21:50:38.843280+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843280+0000","last_undegraded":"2024-09-12T21:50:38.843280+0000","last_fullsized":"2024-09-12T21:50:38.843280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840093+0000","last_change":"2024-09-12T21:50:38.840093+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840093+0000","last_undegraded":"2024-09-12T21:50:38.840093+0000","last_fullsized":"2024-09-12T21:50:38.840093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843793+0000","last_change":"2024-09-12T21:50:38.843793+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843793+0000","last_undegraded":"2024-09-12T21:50:38.843793+0000","last_fullsized":"2024-09-12T21:50:38.843793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840111+0000","last_change":"2024-09-12T21:50:38.840111+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840111+0000","last_undegraded":"2024-09-12T21:50:38.840111+0000","last_fullsized":"2024-09-12T21:50:38.840111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843583+0000","last_change":"2024-09-12T21:50:38.843583+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843583+0000","last_undegraded":"2024-09-12T21:50:38.843583+0000","last_fullsized":"2024-09-12T21:50:38.843583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842721+0000","last_change":"2024-09-12T21:50:38.842721+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842721+0000","last_undegraded":"2024-09-12T21:50:38.842721+0000","last_fullsized":"2024-09-12T21:50:38.842721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841149+0000","last_change":"2024-09-12T21:50:38.841149+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841149+0000","last_undegraded":"2024-09-12T21:50:38.841149+0000","last_fullsized":"2024-09-12T21:50:38.841149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853177+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:38.853177+0000","last_peered":"2024-09-12T21:50:38.853177+0000","last_clean":"2024-09-12T21:50:38.853177+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:38.853177+0000","last_undegraded":"2024-09-12T21:50:38.853177+0000","last_fullsized":"2024-09-12T21:50:38.853177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840172+0000","last_change":"2024-09-12T21:50:38.840172+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840172+0000","last_undegraded":"2024-09-12T21:50:38.840172+0000","last_fullsized":"2024-09-12T21:50:38.840172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853307+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:38.853307+0000","last_peered":"2024-09-12T21:50:38.853307+0000","last_clean":"2024-09-12T21:50:38.853307+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:38.853307+0000","last_undegraded":"2024-09-12T21:50:38.853307+0000","last_fullsized":"2024-09-12T21:50:38.853307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842956+0000","last_change":"2024-09-12T21:50:38.842956+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842956+0000","last_undegraded":"2024-09-12T21:50:38.842956+0000","last_fullsized":"2024-09-12T21:50:38.842956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852002+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:38.852002+0000","last_peered":"2024-09-12T21:50:38.852002+0000","last_clean":"2024-09-12T21:50:38.852002+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:38.852002+0000","last_undegraded":"2024-09-12T21:50:38.852002+0000","last_fullsized":"2024-09-12T21:50:38.852002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:13.063934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843413+0000","last_change":"2024-09-12T21:50:38.843413+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843413+0000","last_undegraded":"2024-09-12T21:50:38.843413+0000","last_fullsized":"2024-09-12T21:50:38.843413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860027+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:38.860027+0000","last_peered":"2024-09-12T21:50:38.860027+0000","last_clean":"2024-09-12T21:50:38.860027+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:38.860027+0000","last_undegraded":"2024-09-12T21:50:38.860027+0000","last_fullsized":"2024-09-12T21:50:38.860027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859991+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:38.859991+0000","last_peered":"2024-09-12T21:50:38.859991+0000","last_clean":"2024-09-12T21:50:38.859991+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:38.859991+0000","last_undegraded":"2024-09-12T21:50:38.859991+0000","last_fullsized":"2024-09-12T21:50:38.859991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840162+0000","last_change":"2024-09-12T21:50:38.840162+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840162+0000","last_undegraded":"2024-09-12T21:50:38.840162+0000","last_fullsized":"2024-09-12T21:50:38.840162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851974+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:38.851974+0000","last_peered":"2024-09-12T21:50:38.851974+0000","last_clean":"2024-09-12T21:50:38.851974+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:38.851974+0000","last_undegraded":"2024-09-12T21:50:38.851974+0000","last_fullsized":"2024-09-12T21:50:38.851974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.180337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842083+0000","last_change":"2024-09-12T21:50:38.842083+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842083+0000","last_undegraded":"2024-09-12T21:50:38.842083+0000","last_fullsized":"2024-09-12T21:50:38.842083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860025+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:38.860025+0000","last_peered":"2024-09-12T21:50:38.860025+0000","last_clean":"2024-09-12T21:50:38.860025+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:38.860025+0000","last_undegraded":"2024-09-12T21:50:38.860025+0000","last_fullsized":"2024-09-12T21:50:38.860025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840603+0000","last_change":"2024-09-12T21:50:38.840603+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840603+0000","last_undegraded":"2024-09-12T21:50:38.840603+0000","last_fullsized":"2024-09-12T21:50:38.840603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853293+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:38.853293+0000","last_peered":"2024-09-12T21:50:38.853293+0000","last_clean":"2024-09-12T21:50:38.853293+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:38.853293+0000","last_undegraded":"2024-09-12T21:50:38.853293+0000","last_fullsized":"2024-09-12T21:50:38.853293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842316+0000","last_change":"2024-09-12T21:50:38.842316+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842316+0000","last_undegraded":"2024-09-12T21:50:38.842316+0000","last_fullsized":"2024-09-12T21:50:38.842316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853283+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:38.853283+0000","last_peered":"2024-09-12T21:50:38.853283+0000","last_clean":"2024-09-12T21:50:38.853283+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:38.853283+0000","last_undegraded":"2024-09-12T21:50:38.853283+0000","last_fullsized":"2024-09-12T21:50:38.853283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842217+0000","last_change":"2024-09-12T21:50:38.842217+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842217+0000","last_undegraded":"2024-09-12T21:50:38.842217+0000","last_fullsized":"2024-09-12T21:50:38.842217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853010+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:38.853010+0000","last_peered":"2024-09-12T21:50:38.853010+0000","last_clean":"2024-09-12T21:50:38.853010+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:38.853010+0000","last_undegraded":"2024-09-12T21:50:38.853010+0000","last_fullsized":"2024-09-12T21:50:38.853010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842798+0000","last_change":"2024-09-12T21:50:38.842798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842798+0000","last_undegraded":"2024-09-12T21:50:38.842798+0000","last_fullsized":"2024-09-12T21:50:38.842798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851917+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:38.851917+0000","last_peered":"2024-09-12T21:50:38.851917+0000","last_clean":"2024-09-12T21:50:38.851917+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:38.851917+0000","last_undegraded":"2024-09-12T21:50:38.851917+0000","last_fullsized":"2024-09-12T21:50:38.851917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:54.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841135+0000","last_change":"2024-09-12T21:50:38.841135+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841135+0000","last_undegraded":"2024-09-12T21:50:38.841135+0000","last_fullsized":"2024-09-12T21:50:38.841135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852221+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:38.852221+0000","last_peered":"2024-09-12T21:50:38.852221+0000","last_clean":"2024-09-12T21:50:38.852221+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:38.852221+0000","last_undegraded":"2024-09-12T21:50:38.852221+0000","last_fullsized":"2024-09-12T21:50:38.852221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842845+0000","last_change":"2024-09-12T21:50:38.842845+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842845+0000","last_undegraded":"2024-09-12T21:50:38.842845+0000","last_fullsized":"2024-09-12T21:50:38.842845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845219+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:38.845219+0000","last_peered":"2024-09-12T21:50:38.845219+0000","last_clean":"2024-09-12T21:50:38.845219+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:38.845219+0000","last_undegraded":"2024-09-12T21:50:38.845219+0000","last_fullsized":"2024-09-12T21:50:38.845219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845559+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:38.845559+0000","last_peered":"2024-09-12T21:50:38.845559+0000","last_clean":"2024-09-12T21:50:38.845559+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:38.845559+0000","last_undegraded":"2024-09-12T21:50:38.845559+0000","last_fullsized":"2024-09-12T21:50:38.845559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853197+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:38.853197+0000","last_peered":"2024-09-12T21:50:38.853197+0000","last_clean":"2024-09-12T21:50:38.853197+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:38.853197+0000","last_undegraded":"2024-09-12T21:50:38.853197+0000","last_fullsized":"2024-09-12T21:50:38.853197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842077+0000","last_change":"2024-09-12T21:50:38.842077+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842077+0000","last_undegraded":"2024-09-12T21:50:38.842077+0000","last_fullsized":"2024-09-12T21:50:38.842077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845178+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:38.845178+0000","last_peered":"2024-09-12T21:50:38.845178+0000","last_clean":"2024-09-12T21:50:38.845178+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:38.845178+0000","last_undegraded":"2024-09-12T21:50:38.845178+0000","last_fullsized":"2024-09-12T21:50:38.845178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853126+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:38.853126+0000","last_peered":"2024-09-12T21:50:38.853126+0000","last_clean":"2024-09-12T21:50:38.853126+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:38.853126+0000","last_undegraded":"2024-09-12T21:50:38.853126+0000","last_fullsized":"2024-09-12T21:50:38.853126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841264+0000","last_change":"2024-09-12T21:50:38.841264+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841264+0000","last_undegraded":"2024-09-12T21:50:38.841264+0000","last_fullsized":"2024-09-12T21:50:38.841264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840136+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:38.840136+0000","last_peered":"2024-09-12T21:50:38.840136+0000","last_clean":"2024-09-12T21:50:38.840136+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:38.840136+0000","last_undegraded":"2024-09-12T21:50:38.840136+0000","last_fullsized":"2024-09-12T21:50:38.840136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851998+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:38.851998+0000","last_peered":"2024-09-12T21:50:38.851998+0000","last_clean":"2024-09-12T21:50:38.851998+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:38.851998+0000","last_undegraded":"2024-09-12T21:50:38.851998+0000","last_fullsized":"2024-09-12T21:50:38.851998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.034144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842331+0000","last_change":"2024-09-12T21:50:38.842331+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842331+0000","last_undegraded":"2024-09-12T21:50:38.842331+0000","last_fullsized":"2024-09-12T21:50:38.842331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845352+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:38.845352+0000","last_peered":"2024-09-12T21:50:38.845352+0000","last_clean":"2024-09-12T21:50:38.845352+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:38.845352+0000","last_undegraded":"2024-09-12T21:50:38.845352+0000","last_fullsized":"2024-09-12T21:50:38.845352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853958+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:38.853958+0000","last_peered":"2024-09-12T21:50:38.853958+0000","last_clean":"2024-09-12T21:50:38.853958+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:38.853958+0000","last_undegraded":"2024-09-12T21:50:38.853958+0000","last_fullsized":"2024-09-12T21:50:38.853958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842297+0000","last_change":"2024-09-12T21:50:38.842297+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842297+0000","last_undegraded":"2024-09-12T21:50:38.842297+0000","last_fullsized":"2024-09-12T21:50:38.842297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853510+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:38.853510+0000","last_peered":"2024-09-12T21:50:38.853510+0000","last_clean":"2024-09-12T21:50:38.853510+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:38.853510+0000","last_undegraded":"2024-09-12T21:50:38.853510+0000","last_fullsized":"2024-09-12T21:50:38.853510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.839925+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:38.839925+0000","last_peered":"2024-09-12T21:50:38.839925+0000","last_clean":"2024-09-12T21:50:38.839925+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:38.839925+0000","last_undegraded":"2024-09-12T21:50:38.839925+0000","last_fullsized":"2024-09-12T21:50:38.839925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841197+0000","last_change":"2024-09-12T21:50:38.841197+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841197+0000","last_undegraded":"2024-09-12T21:50:38.841197+0000","last_fullsized":"2024-09-12T21:50:38.841197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855572+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:38.855572+0000","last_peered":"2024-09-12T21:50:38.855572+0000","last_clean":"2024-09-12T21:50:38.855572+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:38.855572+0000","last_undegraded":"2024-09-12T21:50:38.855572+0000","last_fullsized":"2024-09-12T21:50:38.855572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845021+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:38.845021+0000","last_peered":"2024-09-12T21:50:38.845021+0000","last_clean":"2024-09-12T21:50:38.845021+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:38.845021+0000","last_undegraded":"2024-09-12T21:50:38.845021+0000","last_fullsized":"2024-09-12T21:50:38.845021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841695+0000","last_change":"2024-09-12T21:50:38.841695+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841695+0000","last_undegraded":"2024-09-12T21:50:38.841695+0000","last_fullsized":"2024-09-12T21:50:38.841695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855601+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:38.855601+0000","last_peered":"2024-09-12T21:50:38.855601+0000","last_clean":"2024-09-12T21:50:38.855601+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:38.855601+0000","last_undegraded":"2024-09-12T21:50:38.855601+0000","last_fullsized":"2024-09-12T21:50:38.855601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840469+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:38.840469+0000","last_peered":"2024-09-12T21:50:38.840469+0000","last_clean":"2024-09-12T21:50:38.840469+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:38.840469+0000","last_undegraded":"2024-09-12T21:50:38.840469+0000","last_fullsized":"2024-09-12T21:50:38.840469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842361+0000","last_change":"2024-09-12T21:50:38.842361+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842361+0000","last_undegraded":"2024-09-12T21:50:38.842361+0000","last_fullsized":"2024-09-12T21:50:38.842361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853308+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:38.853308+0000","last_peered":"2024-09-12T21:50:38.853308+0000","last_clean":"2024-09-12T21:50:38.853308+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:38.853308+0000","last_undegraded":"2024-09-12T21:50:38.853308+0000","last_fullsized":"2024-09-12T21:50:38.853308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845882+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:38.845882+0000","last_peered":"2024-09-12T21:50:38.845882+0000","last_clean":"2024-09-12T21:50:38.845882+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:38.845882+0000","last_undegraded":"2024-09-12T21:50:38.845882+0000","last_fullsized":"2024-09-12T21:50:38.845882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841081+0000","last_change":"2024-09-12T21:50:38.841081+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841081+0000","last_undegraded":"2024-09-12T21:50:38.841081+0000","last_fullsized":"2024-09-12T21:50:38.841081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841605+0000","last_change":"2024-09-12T21:50:38.841605+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841605+0000","last_undegraded":"2024-09-12T21:50:38.841605+0000","last_fullsized":"2024-09-12T21:50:38.841605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859987+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:38.859987+0000","last_peered":"2024-09-12T21:50:38.859987+0000","last_clean":"2024-09-12T21:50:38.859987+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:38.859987+0000","last_undegraded":"2024-09-12T21:50:38.859987+0000","last_fullsized":"2024-09-12T21:50:38.859987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:39.214292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842952+0000","last_change":"2024-09-12T21:50:38.842952+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842952+0000","last_undegraded":"2024-09-12T21:50:38.842952+0000","last_fullsized":"2024-09-12T21:50:38.842952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852016+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:38.852016+0000","last_peered":"2024-09-12T21:50:38.852016+0000","last_clean":"2024-09-12T21:50:38.852016+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:38.852016+0000","last_undegraded":"2024-09-12T21:50:38.852016+0000","last_fullsized":"2024-09-12T21:50:38.852016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.857032+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:38.857032+0000","last_peered":"2024-09-12T21:50:38.857032+0000","last_clean":"2024-09-12T21:50:38.857032+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:38.857032+0000","last_undegraded":"2024-09-12T21:50:38.857032+0000","last_fullsized":"2024-09-12T21:50:38.857032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842945+0000","last_change":"2024-09-12T21:50:38.842945+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842945+0000","last_undegraded":"2024-09-12T21:50:38.842945+0000","last_fullsized":"2024-09-12T21:50:38.842945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855624+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:38.855624+0000","last_peered":"2024-09-12T21:50:38.855624+0000","last_clean":"2024-09-12T21:50:38.855624+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:38.855624+0000","last_undegraded":"2024-09-12T21:50:38.855624+0000","last_fullsized":"2024-09-12T21:50:38.855624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843004+0000","last_change":"2024-09-12T21:50:38.843004+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843004+0000","last_undegraded":"2024-09-12T21:50:38.843004+0000","last_fullsized":"2024-09-12T21:50:38.843004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840289+0000","last_change":"2024-09-12T21:50:38.840289+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840289+0000","last_undegraded":"2024-09-12T21:50:38.840289+0000","last_fullsized":"2024-09-12T21:50:38.840289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853186+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:38.853186+0000","last_peered":"2024-09-12T21:50:38.853186+0000","last_clean":"2024-09-12T21:50:38.853186+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:38.853186+0000","last_undegraded":"2024-09-12T21:50:38.853186+0000","last_fullsized":"2024-09-12T21:50:38.853186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843558+0000","last_change":"2024-09-12T21:50:38.843558+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843558+0000","last_undegraded":"2024-09-12T21:50:38.843558+0000","last_fullsized":"2024-09-12T21:50:38.843558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853265+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:38.853265+0000","last_peered":"2024-09-12T21:50:38.853265+0000","last_clean":"2024-09-12T21:50:38.853265+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:38.853265+0000","last_undegraded":"2024-09-12T21:50:38.853265+0000","last_fullsized":"2024-09-12T21:50:38.853265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841165+0000","last_change":"2024-09-12T21:50:38.841165+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841165+0000","last_undegraded":"2024-09-12T21:50:38.841165+0000","last_fullsized":"2024-09-12T21:50:38.841165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851930+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:38.851930+0000","last_peered":"2024-09-12T21:50:38.851930+0000","last_clean":"2024-09-12T21:50:38.851930+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:38.851930+0000","last_undegraded":"2024-09-12T21:50:38.851930+0000","last_fullsized":"2024-09-12T21:50:38.851930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:26.477264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842078+0000","last_change":"2024-09-12T21:50:38.842078+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842078+0000","last_undegraded":"2024-09-12T21:50:38.842078+0000","last_fullsized":"2024-09-12T21:50:38.842078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851467+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:38.851467+0000","last_peered":"2024-09-12T21:50:38.851467+0000","last_clean":"2024-09-12T21:50:38.851467+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:38.851467+0000","last_undegraded":"2024-09-12T21:50:38.851467+0000","last_fullsized":"2024-09-12T21:50:38.851467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:15.075969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842545+0000","last_change":"2024-09-12T21:50:38.842545+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842545+0000","last_undegraded":"2024-09-12T21:50:38.842545+0000","last_fullsized":"2024-09-12T21:50:38.842545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853891+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:38.853891+0000","last_peered":"2024-09-12T21:50:38.853891+0000","last_clean":"2024-09-12T21:50:38.853891+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:38.853891+0000","last_undegraded":"2024-09-12T21:50:38.853891+0000","last_fullsized":"2024-09-12T21:50:38.853891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842064+0000","last_change":"2024-09-12T21:50:38.842064+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842064+0000","last_undegraded":"2024-09-12T21:50:38.842064+0000","last_fullsized":"2024-09-12T21:50:38.842064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851954+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:38.851954+0000","last_peered":"2024-09-12T21:50:38.851954+0000","last_clean":"2024-09-12T21:50:38.851954+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:38.851954+0000","last_undegraded":"2024-09-12T21:50:38.851954+0000","last_fullsized":"2024-09-12T21:50:38.851954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:12.920344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.839970+0000","last_change":"2024-09-12T21:50:38.839970+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.839970+0000","last_undegraded":"2024-09-12T21:50:38.839970+0000","last_fullsized":"2024-09-12T21:50:38.839970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853214+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:38.853214+0000","last_peered":"2024-09-12T21:50:38.853214+0000","last_clean":"2024-09-12T21:50:38.853214+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:38.853214+0000","last_undegraded":"2024-09-12T21:50:38.853214+0000","last_fullsized":"2024-09-12T21:50:38.853214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842013+0000","last_change":"2024-09-12T21:50:38.842013+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842013+0000","last_undegraded":"2024-09-12T21:50:38.842013+0000","last_fullsized":"2024-09-12T21:50:38.842013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853312+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:38.853312+0000","last_peered":"2024-09-12T21:50:38.853312+0000","last_clean":"2024-09-12T21:50:38.853312+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:38.853312+0000","last_undegraded":"2024-09-12T21:50:38.853312+0000","last_fullsized":"2024-09-12T21:50:38.853312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:42.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:43.162 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:43.164 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:43.173 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T21:50:42.857051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86840,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028680,"statfs":{"total":289910292480,"available":289821368320,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025685"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842572+0000","last_change":"2024-09-12T21:50:38.842572+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842572+0000","last_undegraded":"2024-09-12T21:50:38.842572+0000","last_fullsized":"2024-09-12T21:50:38.842572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842829+0000","last_change":"2024-09-12T21:50:38.842829+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842829+0000","last_undegraded":"2024-09-12T21:50:38.842829+0000","last_fullsized":"2024-09-12T21:50:38.842829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844581+0000","last_change":"2024-09-12T21:50:38.844581+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844581+0000","last_undegraded":"2024-09-12T21:50:38.844581+0000","last_fullsized":"2024-09-12T21:50:38.844581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840148+0000","last_change":"2024-09-12T21:50:38.840148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840148+0000","last_undegraded":"2024-09-12T21:50:38.840148+0000","last_fullsized":"2024-09-12T21:50:38.840148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844355+0000","last_change":"2024-09-12T21:50:38.844355+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844355+0000","last_undegraded":"2024-09-12T21:50:38.844355+0000","last_fullsized":"2024-09-12T21:50:38.844355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843802+0000","last_change":"2024-09-12T21:50:38.843802+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843802+0000","last_undegraded":"2024-09-12T21:50:38.843802+0000","last_fullsized":"2024-09-12T21:50:38.843802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844006+0000","last_change":"2024-09-12T21:50:38.844006+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844006+0000","last_undegraded":"2024-09-12T21:50:38.844006+0000","last_fullsized":"2024-09-12T21:50:38.844006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842159+0000","last_change":"2024-09-12T21:50:38.842159+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842159+0000","last_undegraded":"2024-09-12T21:50:38.842159+0000","last_fullsized":"2024-09-12T21:50:38.842159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843798+0000","last_change":"2024-09-12T21:50:38.843798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843798+0000","last_undegraded":"2024-09-12T21:50:38.843798+0000","last_fullsized":"2024-09-12T21:50:38.843798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842820+0000","last_change":"2024-09-12T21:50:38.842820+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842820+0000","last_undegraded":"2024-09-12T21:50:38.842820+0000","last_fullsized":"2024-09-12T21:50:38.842820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842445+0000","last_change":"2024-09-12T21:50:38.842445+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842445+0000","last_undegraded":"2024-09-12T21:50:38.842445+0000","last_fullsized":"2024-09-12T21:50:38.842445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842767+0000","last_change":"2024-09-12T21:50:38.842767+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842767+0000","last_undegraded":"2024-09-12T21:50:38.842767+0000","last_fullsized":"2024-09-12T21:50:38.842767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842539+0000","last_change":"2024-09-12T21:50:38.842539+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842539+0000","last_undegraded":"2024-09-12T21:50:38.842539+0000","last_fullsized":"2024-09-12T21:50:38.842539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843210+0000","last_change":"2024-09-12T21:50:38.843210+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843210+0000","last_undegraded":"2024-09-12T21:50:38.843210+0000","last_fullsized":"2024-09-12T21:50:38.843210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844148+0000","last_change":"2024-09-12T21:50:38.844148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844148+0000","last_undegraded":"2024-09-12T21:50:38.844148+0000","last_fullsized":"2024-09-12T21:50:38.844148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840296+0000","last_change":"2024-09-12T21:50:38.840296+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840296+0000","last_undegraded":"2024-09-12T21:50:38.840296+0000","last_fullsized":"2024-09-12T21:50:38.840296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844191+0000","last_change":"2024-09-12T21:50:38.844191+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844191+0000","last_undegraded":"2024-09-12T21:50:38.844191+0000","last_fullsized":"2024-09-12T21:50:38.844191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842890+0000","last_change":"2024-09-12T21:50:38.842890+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842890+0000","last_undegraded":"2024-09-12T21:50:38.842890+0000","last_fullsized":"2024-09-12T21:50:38.842890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843166+0000","last_change":"2024-09-12T21:50:38.843166+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843166+0000","last_undegraded":"2024-09-12T21:50:38.843166+0000","last_fullsized":"2024-09-12T21:50:38.843166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842052+0000","last_change":"2024-09-12T21:50:38.842052+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842052+0000","last_undegraded":"2024-09-12T21:50:38.842052+0000","last_fullsized":"2024-09-12T21:50:38.842052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844005+0000","last_change":"2024-09-12T21:50:38.844005+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844005+0000","last_undegraded":"2024-09-12T21:50:38.844005+0000","last_fullsized":"2024-09-12T21:50:38.844005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841746+0000","last_change":"2024-09-12T21:50:38.841746+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841746+0000","last_undegraded":"2024-09-12T21:50:38.841746+0000","last_fullsized":"2024-09-12T21:50:38.841746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841278+0000","last_change":"2024-09-12T21:50:38.841278+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841278+0000","last_undegraded":"2024-09-12T21:50:38.841278+0000","last_fullsized":"2024-09-12T21:50:38.841278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843985+0000","last_change":"2024-09-12T21:50:38.843985+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843985+0000","last_undegraded":"2024-09-12T21:50:38.843985+0000","last_fullsized":"2024-09-12T21:50:38.843985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843280+0000","last_change":"2024-09-12T21:50:38.843280+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843280+0000","last_undegraded":"2024-09-12T21:50:38.843280+0000","last_fullsized":"2024-09-12T21:50:38.843280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840093+0000","last_change":"2024-09-12T21:50:38.840093+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840093+0000","last_undegraded":"2024-09-12T21:50:38.840093+0000","last_fullsized":"2024-09-12T21:50:38.840093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843793+0000","last_change":"2024-09-12T21:50:38.843793+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843793+0000","last_undegraded":"2024-09-12T21:50:38.843793+0000","last_fullsized":"2024-09-12T21:50:38.843793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840111+0000","last_change":"2024-09-12T21:50:38.840111+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840111+0000","last_undegraded":"2024-09-12T21:50:38.840111+0000","last_fullsized":"2024-09-12T21:50:38.840111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843583+0000","last_change":"2024-09-12T21:50:38.843583+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843583+0000","last_undegraded":"2024-09-12T21:50:38.843583+0000","last_fullsized":"2024-09-12T21:50:38.843583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842721+0000","last_change":"2024-09-12T21:50:38.842721+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842721+0000","last_undegraded":"2024-09-12T21:50:38.842721+0000","last_fullsized":"2024-09-12T21:50:38.842721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841149+0000","last_change":"2024-09-12T21:50:38.841149+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841149+0000","last_undegraded":"2024-09-12T21:50:38.841149+0000","last_fullsized":"2024-09-12T21:50:38.841149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853177+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:38.853177+0000","last_peered":"2024-09-12T21:50:38.853177+0000","last_clean":"2024-09-12T21:50:38.853177+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:38.853177+0000","last_undegraded":"2024-09-12T21:50:38.853177+0000","last_fullsized":"2024-09-12T21:50:38.853177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840172+0000","last_change":"2024-09-12T21:50:38.840172+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840172+0000","last_undegraded":"2024-09-12T21:50:38.840172+0000","last_fullsized":"2024-09-12T21:50:38.840172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853307+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:38.853307+0000","last_peered":"2024-09-12T21:50:38.853307+0000","last_clean":"2024-09-12T21:50:38.853307+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:38.853307+0000","last_undegraded":"2024-09-12T21:50:38.853307+0000","last_fullsized":"2024-09-12T21:50:38.853307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842956+0000","last_change":"2024-09-12T21:50:38.842956+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842956+0000","last_undegraded":"2024-09-12T21:50:38.842956+0000","last_fullsized":"2024-09-12T21:50:38.842956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852002+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:38.852002+0000","last_peered":"2024-09-12T21:50:38.852002+0000","last_clean":"2024-09-12T21:50:38.852002+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:38.852002+0000","last_undegraded":"2024-09-12T21:50:38.852002+0000","last_fullsized":"2024-09-12T21:50:38.852002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:13.063934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843413+0000","last_change":"2024-09-12T21:50:38.843413+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843413+0000","last_undegraded":"2024-09-12T21:50:38.843413+0000","last_fullsized":"2024-09-12T21:50:38.843413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860027+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:38.860027+0000","last_peered":"2024-09-12T21:50:38.860027+0000","last_clean":"2024-09-12T21:50:38.860027+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:38.860027+0000","last_undegraded":"2024-09-12T21:50:38.860027+0000","last_fullsized":"2024-09-12T21:50:38.860027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859991+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:38.859991+0000","last_peered":"2024-09-12T21:50:38.859991+0000","last_clean":"2024-09-12T21:50:38.859991+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:38.859991+0000","last_undegraded":"2024-09-12T21:50:38.859991+0000","last_fullsized":"2024-09-12T21:50:38.859991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840162+0000","last_change":"2024-09-12T21:50:38.840162+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840162+0000","last_undegraded":"2024-09-12T21:50:38.840162+0000","last_fullsized":"2024-09-12T21:50:38.840162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851974+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:38.851974+0000","last_peered":"2024-09-12T21:50:38.851974+0000","last_clean":"2024-09-12T21:50:38.851974+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:38.851974+0000","last_undegraded":"2024-09-12T21:50:38.851974+0000","last_fullsized":"2024-09-12T21:50:38.851974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.180337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842083+0000","last_change":"2024-09-12T21:50:38.842083+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842083+0000","last_undegraded":"2024-09-12T21:50:38.842083+0000","last_fullsized":"2024-09-12T21:50:38.842083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860025+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:38.860025+0000","last_peered":"2024-09-12T21:50:38.860025+0000","last_clean":"2024-09-12T21:50:38.860025+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:38.860025+0000","last_undegraded":"2024-09-12T21:50:38.860025+0000","last_fullsized":"2024-09-12T21:50:38.860025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840603+0000","last_change":"2024-09-12T21:50:38.840603+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840603+0000","last_undegraded":"2024-09-12T21:50:38.840603+0000","last_fullsized":"2024-09-12T21:50:38.840603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853293+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:38.853293+0000","last_peered":"2024-09-12T21:50:38.853293+0000","last_clean":"2024-09-12T21:50:38.853293+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:38.853293+0000","last_undegraded":"2024-09-12T21:50:38.853293+0000","last_fullsized":"2024-09-12T21:50:38.853293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842316+0000","last_change":"2024-09-12T21:50:38.842316+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842316+0000","last_undegraded":"2024-09-12T21:50:38.842316+0000","last_fullsized":"2024-09-12T21:50:38.842316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853283+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:38.853283+0000","last_peered":"2024-09-12T21:50:38.853283+0000","last_clean":"2024-09-12T21:50:38.853283+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:38.853283+0000","last_undegraded":"2024-09-12T21:50:38.853283+0000","last_fullsized":"2024-09-12T21:50:38.853283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842217+0000","last_change":"2024-09-12T21:50:38.842217+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842217+0000","last_undegraded":"2024-09-12T21:50:38.842217+0000","last_fullsized":"2024-09-12T21:50:38.842217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853010+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:38.853010+0000","last_peered":"2024-09-12T21:50:38.853010+0000","last_clean":"2024-09-12T21:50:38.853010+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:38.853010+0000","last_undegraded":"2024-09-12T21:50:38.853010+0000","last_fullsized":"2024-09-12T21:50:38.853010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842798+0000","last_change":"2024-09-12T21:50:38.842798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842798+0000","last_undegraded":"2024-09-12T21:50:38.842798+0000","last_fullsized":"2024-09-12T21:50:38.842798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851917+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:38.851917+0000","last_peered":"2024-09-12T21:50:38.851917+0000","last_clean":"2024-09-12T21:50:38.851917+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:38.851917+0000","last_undegraded":"2024-09-12T21:50:38.851917+0000","last_fullsized":"2024-09-12T21:50:38.851917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:54.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841135+0000","last_change":"2024-09-12T21:50:38.841135+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841135+0000","last_undegraded":"2024-09-12T21:50:38.841135+0000","last_fullsized":"2024-09-12T21:50:38.841135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852221+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:38.852221+0000","last_peered":"2024-09-12T21:50:38.852221+0000","last_clean":"2024-09-12T21:50:38.852221+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:38.852221+0000","last_undegraded":"2024-09-12T21:50:38.852221+0000","last_fullsized":"2024-09-12T21:50:38.852221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842845+0000","last_change":"2024-09-12T21:50:38.842845+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842845+0000","last_undegraded":"2024-09-12T21:50:38.842845+0000","last_fullsized":"2024-09-12T21:50:38.842845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845219+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:38.845219+0000","last_peered":"2024-09-12T21:50:38.845219+0000","last_clean":"2024-09-12T21:50:38.845219+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:38.845219+0000","last_undegraded":"2024-09-12T21:50:38.845219+0000","last_fullsized":"2024-09-12T21:50:38.845219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845559+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:38.845559+0000","last_peered":"2024-09-12T21:50:38.845559+0000","last_clean":"2024-09-12T21:50:38.845559+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:38.845559+0000","last_undegraded":"2024-09-12T21:50:38.845559+0000","last_fullsized":"2024-09-12T21:50:38.845559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853197+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:38.853197+0000","last_peered":"2024-09-12T21:50:38.853197+0000","last_clean":"2024-09-12T21:50:38.853197+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:38.853197+0000","last_undegraded":"2024-09-12T21:50:38.853197+0000","last_fullsized":"2024-09-12T21:50:38.853197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842077+0000","last_change":"2024-09-12T21:50:38.842077+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842077+0000","last_undegraded":"2024-09-12T21:50:38.842077+0000","last_fullsized":"2024-09-12T21:50:38.842077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845178+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:38.845178+0000","last_peered":"2024-09-12T21:50:38.845178+0000","last_clean":"2024-09-12T21:50:38.845178+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:38.845178+0000","last_undegraded":"2024-09-12T21:50:38.845178+0000","last_fullsized":"2024-09-12T21:50:38.845178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853126+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:38.853126+0000","last_peered":"2024-09-12T21:50:38.853126+0000","last_clean":"2024-09-12T21:50:38.853126+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:38.853126+0000","last_undegraded":"2024-09-12T21:50:38.853126+0000","last_fullsized":"2024-09-12T21:50:38.853126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841264+0000","last_change":"2024-09-12T21:50:38.841264+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841264+0000","last_undegraded":"2024-09-12T21:50:38.841264+0000","last_fullsized":"2024-09-12T21:50:38.841264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840136+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:38.840136+0000","last_peered":"2024-09-12T21:50:38.840136+0000","last_clean":"2024-09-12T21:50:38.840136+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:38.840136+0000","last_undegraded":"2024-09-12T21:50:38.840136+0000","last_fullsized":"2024-09-12T21:50:38.840136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851998+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:38.851998+0000","last_peered":"2024-09-12T21:50:38.851998+0000","last_clean":"2024-09-12T21:50:38.851998+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:38.851998+0000","last_undegraded":"2024-09-12T21:50:38.851998+0000","last_fullsized":"2024-09-12T21:50:38.851998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.034144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842331+0000","last_change":"2024-09-12T21:50:38.842331+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842331+0000","last_undegraded":"2024-09-12T21:50:38.842331+0000","last_fullsized":"2024-09-12T21:50:38.842331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845352+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:38.845352+0000","last_peered":"2024-09-12T21:50:38.845352+0000","last_clean":"2024-09-12T21:50:38.845352+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:38.845352+0000","last_undegraded":"2024-09-12T21:50:38.845352+0000","last_fullsized":"2024-09-12T21:50:38.845352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853958+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:38.853958+0000","last_peered":"2024-09-12T21:50:38.853958+0000","last_clean":"2024-09-12T21:50:38.853958+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:38.853958+0000","last_undegraded":"2024-09-12T21:50:38.853958+0000","last_fullsized":"2024-09-12T21:50:38.853958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842297+0000","last_change":"2024-09-12T21:50:38.842297+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842297+0000","last_undegraded":"2024-09-12T21:50:38.842297+0000","last_fullsized":"2024-09-12T21:50:38.842297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853510+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:38.853510+0000","last_peered":"2024-09-12T21:50:38.853510+0000","last_clean":"2024-09-12T21:50:38.853510+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:38.853510+0000","last_undegraded":"2024-09-12T21:50:38.853510+0000","last_fullsized":"2024-09-12T21:50:38.853510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.839925+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:38.839925+0000","last_peered":"2024-09-12T21:50:38.839925+0000","last_clean":"2024-09-12T21:50:38.839925+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:38.839925+0000","last_undegraded":"2024-09-12T21:50:38.839925+0000","last_fullsized":"2024-09-12T21:50:38.839925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841197+0000","last_change":"2024-09-12T21:50:38.841197+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841197+0000","last_undegraded":"2024-09-12T21:50:38.841197+0000","last_fullsized":"2024-09-12T21:50:38.841197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855572+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:38.855572+0000","last_peered":"2024-09-12T21:50:38.855572+0000","last_clean":"2024-09-12T21:50:38.855572+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:38.855572+0000","last_undegraded":"2024-09-12T21:50:38.855572+0000","last_fullsized":"2024-09-12T21:50:38.855572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845021+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:38.845021+0000","last_peered":"2024-09-12T21:50:38.845021+0000","last_clean":"2024-09-12T21:50:38.845021+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:38.845021+0000","last_undegraded":"2024-09-12T21:50:38.845021+0000","last_fullsized":"2024-09-12T21:50:38.845021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841695+0000","last_change":"2024-09-12T21:50:38.841695+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841695+0000","last_undegraded":"2024-09-12T21:50:38.841695+0000","last_fullsized":"2024-09-12T21:50:38.841695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855601+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:38.855601+0000","last_peered":"2024-09-12T21:50:38.855601+0000","last_clean":"2024-09-12T21:50:38.855601+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:38.855601+0000","last_undegraded":"2024-09-12T21:50:38.855601+0000","last_fullsized":"2024-09-12T21:50:38.855601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840469+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:38.840469+0000","last_peered":"2024-09-12T21:50:38.840469+0000","last_clean":"2024-09-12T21:50:38.840469+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:38.840469+0000","last_undegraded":"2024-09-12T21:50:38.840469+0000","last_fullsized":"2024-09-12T21:50:38.840469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842361+0000","last_change":"2024-09-12T21:50:38.842361+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842361+0000","last_undegraded":"2024-09-12T21:50:38.842361+0000","last_fullsized":"2024-09-12T21:50:38.842361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853308+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:38.853308+0000","last_peered":"2024-09-12T21:50:38.853308+0000","last_clean":"2024-09-12T21:50:38.853308+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:38.853308+0000","last_undegraded":"2024-09-12T21:50:38.853308+0000","last_fullsized":"2024-09-12T21:50:38.853308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845882+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:38.845882+0000","last_peered":"2024-09-12T21:50:38.845882+0000","last_clean":"2024-09-12T21:50:38.845882+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:38.845882+0000","last_undegraded":"2024-09-12T21:50:38.845882+0000","last_fullsized":"2024-09-12T21:50:38.845882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841081+0000","last_change":"2024-09-12T21:50:38.841081+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841081+0000","last_undegraded":"2024-09-12T21:50:38.841081+0000","last_fullsized":"2024-09-12T21:50:38.841081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841605+0000","last_change":"2024-09-12T21:50:38.841605+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841605+0000","last_undegraded":"2024-09-12T21:50:38.841605+0000","last_fullsized":"2024-09-12T21:50:38.841605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859987+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:38.859987+0000","last_peered":"2024-09-12T21:50:38.859987+0000","last_clean":"2024-09-12T21:50:38.859987+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:38.859987+0000","last_undegraded":"2024-09-12T21:50:38.859987+0000","last_fullsized":"2024-09-12T21:50:38.859987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:39.214292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842952+0000","last_change":"2024-09-12T21:50:38.842952+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842952+0000","last_undegraded":"2024-09-12T21:50:38.842952+0000","last_fullsized":"2024-09-12T21:50:38.842952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852016+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:38.852016+0000","last_peered":"2024-09-12T21:50:38.852016+0000","last_clean":"2024-09-12T21:50:38.852016+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:38.852016+0000","last_undegraded":"2024-09-12T21:50:38.852016+0000","last_fullsized":"2024-09-12T21:50:38.852016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.857032+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:38.857032+0000","last_peered":"2024-09-12T21:50:38.857032+0000","last_clean":"2024-09-12T21:50:38.857032+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:38.857032+0000","last_undegraded":"2024-09-12T21:50:38.857032+0000","last_fullsized":"2024-09-12T21:50:38.857032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842945+0000","last_change":"2024-09-12T21:50:38.842945+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842945+0000","last_undegraded":"2024-09-12T21:50:38.842945+0000","last_fullsized":"2024-09-12T21:50:38.842945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855624+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:38.855624+0000","last_peered":"2024-09-12T21:50:38.855624+0000","last_clean":"2024-09-12T21:50:38.855624+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:38.855624+0000","last_undegraded":"2024-09-12T21:50:38.855624+0000","last_fullsized":"2024-09-12T21:50:38.855624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843004+0000","last_change":"2024-09-12T21:50:38.843004+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843004+0000","last_undegraded":"2024-09-12T21:50:38.843004+0000","last_fullsized":"2024-09-12T21:50:38.843004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840289+0000","last_change":"2024-09-12T21:50:38.840289+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840289+0000","last_undegraded":"2024-09-12T21:50:38.840289+0000","last_fullsized":"2024-09-12T21:50:38.840289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853186+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:38.853186+0000","last_peered":"2024-09-12T21:50:38.853186+0000","last_clean":"2024-09-12T21:50:38.853186+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:38.853186+0000","last_undegraded":"2024-09-12T21:50:38.853186+0000","last_fullsized":"2024-09-12T21:50:38.853186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843558+0000","last_change":"2024-09-12T21:50:38.843558+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843558+0000","last_undegraded":"2024-09-12T21:50:38.843558+0000","last_fullsized":"2024-09-12T21:50:38.843558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853265+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:38.853265+0000","last_peered":"2024-09-12T21:50:38.853265+0000","last_clean":"2024-09-12T21:50:38.853265+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:38.853265+0000","last_undegraded":"2024-09-12T21:50:38.853265+0000","last_fullsized":"2024-09-12T21:50:38.853265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841165+0000","last_change":"2024-09-12T21:50:38.841165+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841165+0000","last_undegraded":"2024-09-12T21:50:38.841165+0000","last_fullsized":"2024-09-12T21:50:38.841165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851930+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:38.851930+0000","last_peered":"2024-09-12T21:50:38.851930+0000","last_clean":"2024-09-12T21:50:38.851930+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:38.851930+0000","last_undegraded":"2024-09-12T21:50:38.851930+0000","last_fullsized":"2024-09-12T21:50:38.851930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:26.477264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842078+0000","last_change":"2024-09-12T21:50:38.842078+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842078+0000","last_undegraded":"2024-09-12T21:50:38.842078+0000","last_fullsized":"2024-09-12T21:50:38.842078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851467+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:38.851467+0000","last_peered":"2024-09-12T21:50:38.851467+0000","last_clean":"2024-09-12T21:50:38.851467+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:38.851467+0000","last_undegraded":"2024-09-12T21:50:38.851467+0000","last_fullsized":"2024-09-12T21:50:38.851467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:15.075969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842545+0000","last_change":"2024-09-12T21:50:38.842545+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842545+0000","last_undegraded":"2024-09-12T21:50:38.842545+0000","last_fullsized":"2024-09-12T21:50:38.842545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853891+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:38.853891+0000","last_peered":"2024-09-12T21:50:38.853891+0000","last_clean":"2024-09-12T21:50:38.853891+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:38.853891+0000","last_undegraded":"2024-09-12T21:50:38.853891+0000","last_fullsized":"2024-09-12T21:50:38.853891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842064+0000","last_change":"2024-09-12T21:50:38.842064+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842064+0000","last_undegraded":"2024-09-12T21:50:38.842064+0000","last_fullsized":"2024-09-12T21:50:38.842064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851954+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:38.851954+0000","last_peered":"2024-09-12T21:50:38.851954+0000","last_clean":"2024-09-12T21:50:38.851954+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:38.851954+0000","last_undegraded":"2024-09-12T21:50:38.851954+0000","last_fullsized":"2024-09-12T21:50:38.851954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:12.920344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.839970+0000","last_change":"2024-09-12T21:50:38.839970+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.839970+0000","last_undegraded":"2024-09-12T21:50:38.839970+0000","last_fullsized":"2024-09-12T21:50:38.839970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853214+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:38.853214+0000","last_peered":"2024-09-12T21:50:38.853214+0000","last_clean":"2024-09-12T21:50:38.853214+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:38.853214+0000","last_undegraded":"2024-09-12T21:50:38.853214+0000","last_fullsized":"2024-09-12T21:50:38.853214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842013+0000","last_change":"2024-09-12T21:50:38.842013+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842013+0000","last_undegraded":"2024-09-12T21:50:38.842013+0000","last_fullsized":"2024-09-12T21:50:38.842013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853312+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:38.853312+0000","last_peered":"2024-09-12T21:50:38.853312+0000","last_clean":"2024-09-12T21:50:38.853312+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:38.853312+0000","last_undegraded":"2024-09-12T21:50:38.853312+0000","last_fullsized":"2024-09-12T21:50:38.853312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:43.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:43.508 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:43.510 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:43.520 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T21:50:43.399795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86840,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028680,"statfs":{"total":289910292480,"available":289821368320,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.561439"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842572+0000","last_change":"2024-09-12T21:50:38.842572+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842572+0000","last_undegraded":"2024-09-12T21:50:38.842572+0000","last_fullsized":"2024-09-12T21:50:38.842572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842829+0000","last_change":"2024-09-12T21:50:38.842829+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842829+0000","last_undegraded":"2024-09-12T21:50:38.842829+0000","last_fullsized":"2024-09-12T21:50:38.842829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844581+0000","last_change":"2024-09-12T21:50:38.844581+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844581+0000","last_undegraded":"2024-09-12T21:50:38.844581+0000","last_fullsized":"2024-09-12T21:50:38.844581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840148+0000","last_change":"2024-09-12T21:50:38.840148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840148+0000","last_undegraded":"2024-09-12T21:50:38.840148+0000","last_fullsized":"2024-09-12T21:50:38.840148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844355+0000","last_change":"2024-09-12T21:50:38.844355+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844355+0000","last_undegraded":"2024-09-12T21:50:38.844355+0000","last_fullsized":"2024-09-12T21:50:38.844355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843802+0000","last_change":"2024-09-12T21:50:38.843802+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843802+0000","last_undegraded":"2024-09-12T21:50:38.843802+0000","last_fullsized":"2024-09-12T21:50:38.843802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844006+0000","last_change":"2024-09-12T21:50:38.844006+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844006+0000","last_undegraded":"2024-09-12T21:50:38.844006+0000","last_fullsized":"2024-09-12T21:50:38.844006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842159+0000","last_change":"2024-09-12T21:50:38.842159+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842159+0000","last_undegraded":"2024-09-12T21:50:38.842159+0000","last_fullsized":"2024-09-12T21:50:38.842159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843798+0000","last_change":"2024-09-12T21:50:38.843798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843798+0000","last_undegraded":"2024-09-12T21:50:38.843798+0000","last_fullsized":"2024-09-12T21:50:38.843798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842820+0000","last_change":"2024-09-12T21:50:38.842820+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842820+0000","last_undegraded":"2024-09-12T21:50:38.842820+0000","last_fullsized":"2024-09-12T21:50:38.842820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842445+0000","last_change":"2024-09-12T21:50:38.842445+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842445+0000","last_undegraded":"2024-09-12T21:50:38.842445+0000","last_fullsized":"2024-09-12T21:50:38.842445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842767+0000","last_change":"2024-09-12T21:50:38.842767+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842767+0000","last_undegraded":"2024-09-12T21:50:38.842767+0000","last_fullsized":"2024-09-12T21:50:38.842767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842539+0000","last_change":"2024-09-12T21:50:38.842539+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842539+0000","last_undegraded":"2024-09-12T21:50:38.842539+0000","last_fullsized":"2024-09-12T21:50:38.842539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843210+0000","last_change":"2024-09-12T21:50:38.843210+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843210+0000","last_undegraded":"2024-09-12T21:50:38.843210+0000","last_fullsized":"2024-09-12T21:50:38.843210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844148+0000","last_change":"2024-09-12T21:50:38.844148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844148+0000","last_undegraded":"2024-09-12T21:50:38.844148+0000","last_fullsized":"2024-09-12T21:50:38.844148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840296+0000","last_change":"2024-09-12T21:50:38.840296+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840296+0000","last_undegraded":"2024-09-12T21:50:38.840296+0000","last_fullsized":"2024-09-12T21:50:38.840296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844191+0000","last_change":"2024-09-12T21:50:38.844191+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844191+0000","last_undegraded":"2024-09-12T21:50:38.844191+0000","last_fullsized":"2024-09-12T21:50:38.844191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842890+0000","last_change":"2024-09-12T21:50:38.842890+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842890+0000","last_undegraded":"2024-09-12T21:50:38.842890+0000","last_fullsized":"2024-09-12T21:50:38.842890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843166+0000","last_change":"2024-09-12T21:50:38.843166+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843166+0000","last_undegraded":"2024-09-12T21:50:38.843166+0000","last_fullsized":"2024-09-12T21:50:38.843166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842052+0000","last_change":"2024-09-12T21:50:38.842052+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842052+0000","last_undegraded":"2024-09-12T21:50:38.842052+0000","last_fullsized":"2024-09-12T21:50:38.842052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844005+0000","last_change":"2024-09-12T21:50:38.844005+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844005+0000","last_undegraded":"2024-09-12T21:50:38.844005+0000","last_fullsized":"2024-09-12T21:50:38.844005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841746+0000","last_change":"2024-09-12T21:50:38.841746+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841746+0000","last_undegraded":"2024-09-12T21:50:38.841746+0000","last_fullsized":"2024-09-12T21:50:38.841746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841278+0000","last_change":"2024-09-12T21:50:38.841278+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841278+0000","last_undegraded":"2024-09-12T21:50:38.841278+0000","last_fullsized":"2024-09-12T21:50:38.841278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843985+0000","last_change":"2024-09-12T21:50:38.843985+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843985+0000","last_undegraded":"2024-09-12T21:50:38.843985+0000","last_fullsized":"2024-09-12T21:50:38.843985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843280+0000","last_change":"2024-09-12T21:50:38.843280+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843280+0000","last_undegraded":"2024-09-12T21:50:38.843280+0000","last_fullsized":"2024-09-12T21:50:38.843280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840093+0000","last_change":"2024-09-12T21:50:38.840093+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840093+0000","last_undegraded":"2024-09-12T21:50:38.840093+0000","last_fullsized":"2024-09-12T21:50:38.840093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843793+0000","last_change":"2024-09-12T21:50:38.843793+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843793+0000","last_undegraded":"2024-09-12T21:50:38.843793+0000","last_fullsized":"2024-09-12T21:50:38.843793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840111+0000","last_change":"2024-09-12T21:50:38.840111+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840111+0000","last_undegraded":"2024-09-12T21:50:38.840111+0000","last_fullsized":"2024-09-12T21:50:38.840111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843583+0000","last_change":"2024-09-12T21:50:38.843583+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843583+0000","last_undegraded":"2024-09-12T21:50:38.843583+0000","last_fullsized":"2024-09-12T21:50:38.843583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842721+0000","last_change":"2024-09-12T21:50:38.842721+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842721+0000","last_undegraded":"2024-09-12T21:50:38.842721+0000","last_fullsized":"2024-09-12T21:50:38.842721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841149+0000","last_change":"2024-09-12T21:50:38.841149+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841149+0000","last_undegraded":"2024-09-12T21:50:38.841149+0000","last_fullsized":"2024-09-12T21:50:38.841149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853177+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:38.853177+0000","last_peered":"2024-09-12T21:50:38.853177+0000","last_clean":"2024-09-12T21:50:38.853177+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:38.853177+0000","last_undegraded":"2024-09-12T21:50:38.853177+0000","last_fullsized":"2024-09-12T21:50:38.853177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840172+0000","last_change":"2024-09-12T21:50:38.840172+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840172+0000","last_undegraded":"2024-09-12T21:50:38.840172+0000","last_fullsized":"2024-09-12T21:50:38.840172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853307+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:38.853307+0000","last_peered":"2024-09-12T21:50:38.853307+0000","last_clean":"2024-09-12T21:50:38.853307+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:38.853307+0000","last_undegraded":"2024-09-12T21:50:38.853307+0000","last_fullsized":"2024-09-12T21:50:38.853307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842956+0000","last_change":"2024-09-12T21:50:38.842956+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842956+0000","last_undegraded":"2024-09-12T21:50:38.842956+0000","last_fullsized":"2024-09-12T21:50:38.842956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852002+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:38.852002+0000","last_peered":"2024-09-12T21:50:38.852002+0000","last_clean":"2024-09-12T21:50:38.852002+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:38.852002+0000","last_undegraded":"2024-09-12T21:50:38.852002+0000","last_fullsized":"2024-09-12T21:50:38.852002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:13.063934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843413+0000","last_change":"2024-09-12T21:50:38.843413+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843413+0000","last_undegraded":"2024-09-12T21:50:38.843413+0000","last_fullsized":"2024-09-12T21:50:38.843413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860027+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:38.860027+0000","last_peered":"2024-09-12T21:50:38.860027+0000","last_clean":"2024-09-12T21:50:38.860027+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:38.860027+0000","last_undegraded":"2024-09-12T21:50:38.860027+0000","last_fullsized":"2024-09-12T21:50:38.860027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859991+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:38.859991+0000","last_peered":"2024-09-12T21:50:38.859991+0000","last_clean":"2024-09-12T21:50:38.859991+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:38.859991+0000","last_undegraded":"2024-09-12T21:50:38.859991+0000","last_fullsized":"2024-09-12T21:50:38.859991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840162+0000","last_change":"2024-09-12T21:50:38.840162+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840162+0000","last_undegraded":"2024-09-12T21:50:38.840162+0000","last_fullsized":"2024-09-12T21:50:38.840162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851974+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:38.851974+0000","last_peered":"2024-09-12T21:50:38.851974+0000","last_clean":"2024-09-12T21:50:38.851974+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:38.851974+0000","last_undegraded":"2024-09-12T21:50:38.851974+0000","last_fullsized":"2024-09-12T21:50:38.851974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.180337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842083+0000","last_change":"2024-09-12T21:50:38.842083+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842083+0000","last_undegraded":"2024-09-12T21:50:38.842083+0000","last_fullsized":"2024-09-12T21:50:38.842083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860025+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:38.860025+0000","last_peered":"2024-09-12T21:50:38.860025+0000","last_clean":"2024-09-12T21:50:38.860025+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:38.860025+0000","last_undegraded":"2024-09-12T21:50:38.860025+0000","last_fullsized":"2024-09-12T21:50:38.860025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840603+0000","last_change":"2024-09-12T21:50:38.840603+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840603+0000","last_undegraded":"2024-09-12T21:50:38.840603+0000","last_fullsized":"2024-09-12T21:50:38.840603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853293+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:38.853293+0000","last_peered":"2024-09-12T21:50:38.853293+0000","last_clean":"2024-09-12T21:50:38.853293+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:38.853293+0000","last_undegraded":"2024-09-12T21:50:38.853293+0000","last_fullsized":"2024-09-12T21:50:38.853293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842316+0000","last_change":"2024-09-12T21:50:38.842316+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842316+0000","last_undegraded":"2024-09-12T21:50:38.842316+0000","last_fullsized":"2024-09-12T21:50:38.842316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853283+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:38.853283+0000","last_peered":"2024-09-12T21:50:38.853283+0000","last_clean":"2024-09-12T21:50:38.853283+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:38.853283+0000","last_undegraded":"2024-09-12T21:50:38.853283+0000","last_fullsized":"2024-09-12T21:50:38.853283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842217+0000","last_change":"2024-09-12T21:50:38.842217+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842217+0000","last_undegraded":"2024-09-12T21:50:38.842217+0000","last_fullsized":"2024-09-12T21:50:38.842217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853010+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:38.853010+0000","last_peered":"2024-09-12T21:50:38.853010+0000","last_clean":"2024-09-12T21:50:38.853010+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:38.853010+0000","last_undegraded":"2024-09-12T21:50:38.853010+0000","last_fullsized":"2024-09-12T21:50:38.853010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842798+0000","last_change":"2024-09-12T21:50:38.842798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842798+0000","last_undegraded":"2024-09-12T21:50:38.842798+0000","last_fullsized":"2024-09-12T21:50:38.842798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851917+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:38.851917+0000","last_peered":"2024-09-12T21:50:38.851917+0000","last_clean":"2024-09-12T21:50:38.851917+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:38.851917+0000","last_undegraded":"2024-09-12T21:50:38.851917+0000","last_fullsized":"2024-09-12T21:50:38.851917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:54.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841135+0000","last_change":"2024-09-12T21:50:38.841135+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841135+0000","last_undegraded":"2024-09-12T21:50:38.841135+0000","last_fullsized":"2024-09-12T21:50:38.841135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852221+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:38.852221+0000","last_peered":"2024-09-12T21:50:38.852221+0000","last_clean":"2024-09-12T21:50:38.852221+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:38.852221+0000","last_undegraded":"2024-09-12T21:50:38.852221+0000","last_fullsized":"2024-09-12T21:50:38.852221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842845+0000","last_change":"2024-09-12T21:50:38.842845+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842845+0000","last_undegraded":"2024-09-12T21:50:38.842845+0000","last_fullsized":"2024-09-12T21:50:38.842845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845219+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:38.845219+0000","last_peered":"2024-09-12T21:50:38.845219+0000","last_clean":"2024-09-12T21:50:38.845219+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:38.845219+0000","last_undegraded":"2024-09-12T21:50:38.845219+0000","last_fullsized":"2024-09-12T21:50:38.845219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845559+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:38.845559+0000","last_peered":"2024-09-12T21:50:38.845559+0000","last_clean":"2024-09-12T21:50:38.845559+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:38.845559+0000","last_undegraded":"2024-09-12T21:50:38.845559+0000","last_fullsized":"2024-09-12T21:50:38.845559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853197+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:38.853197+0000","last_peered":"2024-09-12T21:50:38.853197+0000","last_clean":"2024-09-12T21:50:38.853197+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:38.853197+0000","last_undegraded":"2024-09-12T21:50:38.853197+0000","last_fullsized":"2024-09-12T21:50:38.853197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842077+0000","last_change":"2024-09-12T21:50:38.842077+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842077+0000","last_undegraded":"2024-09-12T21:50:38.842077+0000","last_fullsized":"2024-09-12T21:50:38.842077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845178+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:38.845178+0000","last_peered":"2024-09-12T21:50:38.845178+0000","last_clean":"2024-09-12T21:50:38.845178+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:38.845178+0000","last_undegraded":"2024-09-12T21:50:38.845178+0000","last_fullsized":"2024-09-12T21:50:38.845178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853126+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:38.853126+0000","last_peered":"2024-09-12T21:50:38.853126+0000","last_clean":"2024-09-12T21:50:38.853126+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:38.853126+0000","last_undegraded":"2024-09-12T21:50:38.853126+0000","last_fullsized":"2024-09-12T21:50:38.853126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841264+0000","last_change":"2024-09-12T21:50:38.841264+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841264+0000","last_undegraded":"2024-09-12T21:50:38.841264+0000","last_fullsized":"2024-09-12T21:50:38.841264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840136+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:38.840136+0000","last_peered":"2024-09-12T21:50:38.840136+0000","last_clean":"2024-09-12T21:50:38.840136+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:38.840136+0000","last_undegraded":"2024-09-12T21:50:38.840136+0000","last_fullsized":"2024-09-12T21:50:38.840136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851998+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:38.851998+0000","last_peered":"2024-09-12T21:50:38.851998+0000","last_clean":"2024-09-12T21:50:38.851998+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:38.851998+0000","last_undegraded":"2024-09-12T21:50:38.851998+0000","last_fullsized":"2024-09-12T21:50:38.851998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.034144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842331+0000","last_change":"2024-09-12T21:50:38.842331+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842331+0000","last_undegraded":"2024-09-12T21:50:38.842331+0000","last_fullsized":"2024-09-12T21:50:38.842331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845352+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:38.845352+0000","last_peered":"2024-09-12T21:50:38.845352+0000","last_clean":"2024-09-12T21:50:38.845352+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:38.845352+0000","last_undegraded":"2024-09-12T21:50:38.845352+0000","last_fullsized":"2024-09-12T21:50:38.845352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853958+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:38.853958+0000","last_peered":"2024-09-12T21:50:38.853958+0000","last_clean":"2024-09-12T21:50:38.853958+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:38.853958+0000","last_undegraded":"2024-09-12T21:50:38.853958+0000","last_fullsized":"2024-09-12T21:50:38.853958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842297+0000","last_change":"2024-09-12T21:50:38.842297+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842297+0000","last_undegraded":"2024-09-12T21:50:38.842297+0000","last_fullsized":"2024-09-12T21:50:38.842297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853510+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:38.853510+0000","last_peered":"2024-09-12T21:50:38.853510+0000","last_clean":"2024-09-12T21:50:38.853510+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:38.853510+0000","last_undegraded":"2024-09-12T21:50:38.853510+0000","last_fullsized":"2024-09-12T21:50:38.853510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.839925+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:38.839925+0000","last_peered":"2024-09-12T21:50:38.839925+0000","last_clean":"2024-09-12T21:50:38.839925+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:38.839925+0000","last_undegraded":"2024-09-12T21:50:38.839925+0000","last_fullsized":"2024-09-12T21:50:38.839925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841197+0000","last_change":"2024-09-12T21:50:38.841197+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841197+0000","last_undegraded":"2024-09-12T21:50:38.841197+0000","last_fullsized":"2024-09-12T21:50:38.841197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855572+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:38.855572+0000","last_peered":"2024-09-12T21:50:38.855572+0000","last_clean":"2024-09-12T21:50:38.855572+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:38.855572+0000","last_undegraded":"2024-09-12T21:50:38.855572+0000","last_fullsized":"2024-09-12T21:50:38.855572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845021+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:38.845021+0000","last_peered":"2024-09-12T21:50:38.845021+0000","last_clean":"2024-09-12T21:50:38.845021+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:38.845021+0000","last_undegraded":"2024-09-12T21:50:38.845021+0000","last_fullsized":"2024-09-12T21:50:38.845021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841695+0000","last_change":"2024-09-12T21:50:38.841695+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841695+0000","last_undegraded":"2024-09-12T21:50:38.841695+0000","last_fullsized":"2024-09-12T21:50:38.841695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855601+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:38.855601+0000","last_peered":"2024-09-12T21:50:38.855601+0000","last_clean":"2024-09-12T21:50:38.855601+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:38.855601+0000","last_undegraded":"2024-09-12T21:50:38.855601+0000","last_fullsized":"2024-09-12T21:50:38.855601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840469+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:38.840469+0000","last_peered":"2024-09-12T21:50:38.840469+0000","last_clean":"2024-09-12T21:50:38.840469+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:38.840469+0000","last_undegraded":"2024-09-12T21:50:38.840469+0000","last_fullsized":"2024-09-12T21:50:38.840469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842361+0000","last_change":"2024-09-12T21:50:38.842361+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842361+0000","last_undegraded":"2024-09-12T21:50:38.842361+0000","last_fullsized":"2024-09-12T21:50:38.842361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853308+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:38.853308+0000","last_peered":"2024-09-12T21:50:38.853308+0000","last_clean":"2024-09-12T21:50:38.853308+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:38.853308+0000","last_undegraded":"2024-09-12T21:50:38.853308+0000","last_fullsized":"2024-09-12T21:50:38.853308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845882+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:38.845882+0000","last_peered":"2024-09-12T21:50:38.845882+0000","last_clean":"2024-09-12T21:50:38.845882+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:38.845882+0000","last_undegraded":"2024-09-12T21:50:38.845882+0000","last_fullsized":"2024-09-12T21:50:38.845882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841081+0000","last_change":"2024-09-12T21:50:38.841081+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841081+0000","last_undegraded":"2024-09-12T21:50:38.841081+0000","last_fullsized":"2024-09-12T21:50:38.841081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841605+0000","last_change":"2024-09-12T21:50:38.841605+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841605+0000","last_undegraded":"2024-09-12T21:50:38.841605+0000","last_fullsized":"2024-09-12T21:50:38.841605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859987+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:38.859987+0000","last_peered":"2024-09-12T21:50:38.859987+0000","last_clean":"2024-09-12T21:50:38.859987+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:38.859987+0000","last_undegraded":"2024-09-12T21:50:38.859987+0000","last_fullsized":"2024-09-12T21:50:38.859987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:39.214292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842952+0000","last_change":"2024-09-12T21:50:38.842952+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842952+0000","last_undegraded":"2024-09-12T21:50:38.842952+0000","last_fullsized":"2024-09-12T21:50:38.842952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852016+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:38.852016+0000","last_peered":"2024-09-12T21:50:38.852016+0000","last_clean":"2024-09-12T21:50:38.852016+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:38.852016+0000","last_undegraded":"2024-09-12T21:50:38.852016+0000","last_fullsized":"2024-09-12T21:50:38.852016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.857032+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:38.857032+0000","last_peered":"2024-09-12T21:50:38.857032+0000","last_clean":"2024-09-12T21:50:38.857032+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:38.857032+0000","last_undegraded":"2024-09-12T21:50:38.857032+0000","last_fullsized":"2024-09-12T21:50:38.857032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842945+0000","last_change":"2024-09-12T21:50:38.842945+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842945+0000","last_undegraded":"2024-09-12T21:50:38.842945+0000","last_fullsized":"2024-09-12T21:50:38.842945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855624+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:38.855624+0000","last_peered":"2024-09-12T21:50:38.855624+0000","last_clean":"2024-09-12T21:50:38.855624+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:38.855624+0000","last_undegraded":"2024-09-12T21:50:38.855624+0000","last_fullsized":"2024-09-12T21:50:38.855624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843004+0000","last_change":"2024-09-12T21:50:38.843004+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843004+0000","last_undegraded":"2024-09-12T21:50:38.843004+0000","last_fullsized":"2024-09-12T21:50:38.843004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840289+0000","last_change":"2024-09-12T21:50:38.840289+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840289+0000","last_undegraded":"2024-09-12T21:50:38.840289+0000","last_fullsized":"2024-09-12T21:50:38.840289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853186+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:38.853186+0000","last_peered":"2024-09-12T21:50:38.853186+0000","last_clean":"2024-09-12T21:50:38.853186+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:38.853186+0000","last_undegraded":"2024-09-12T21:50:38.853186+0000","last_fullsized":"2024-09-12T21:50:38.853186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843558+0000","last_change":"2024-09-12T21:50:38.843558+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843558+0000","last_undegraded":"2024-09-12T21:50:38.843558+0000","last_fullsized":"2024-09-12T21:50:38.843558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853265+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:38.853265+0000","last_peered":"2024-09-12T21:50:38.853265+0000","last_clean":"2024-09-12T21:50:38.853265+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:38.853265+0000","last_undegraded":"2024-09-12T21:50:38.853265+0000","last_fullsized":"2024-09-12T21:50:38.853265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841165+0000","last_change":"2024-09-12T21:50:38.841165+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841165+0000","last_undegraded":"2024-09-12T21:50:38.841165+0000","last_fullsized":"2024-09-12T21:50:38.841165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851930+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:38.851930+0000","last_peered":"2024-09-12T21:50:38.851930+0000","last_clean":"2024-09-12T21:50:38.851930+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:38.851930+0000","last_undegraded":"2024-09-12T21:50:38.851930+0000","last_fullsized":"2024-09-12T21:50:38.851930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:26.477264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842078+0000","last_change":"2024-09-12T21:50:38.842078+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842078+0000","last_undegraded":"2024-09-12T21:50:38.842078+0000","last_fullsized":"2024-09-12T21:50:38.842078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851467+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:38.851467+0000","last_peered":"2024-09-12T21:50:38.851467+0000","last_clean":"2024-09-12T21:50:38.851467+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:38.851467+0000","last_undegraded":"2024-09-12T21:50:38.851467+0000","last_fullsized":"2024-09-12T21:50:38.851467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:15.075969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842545+0000","last_change":"2024-09-12T21:50:38.842545+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842545+0000","last_undegraded":"2024-09-12T21:50:38.842545+0000","last_fullsized":"2024-09-12T21:50:38.842545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853891+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:38.853891+0000","last_peered":"2024-09-12T21:50:38.853891+0000","last_clean":"2024-09-12T21:50:38.853891+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:38.853891+0000","last_undegraded":"2024-09-12T21:50:38.853891+0000","last_fullsized":"2024-09-12T21:50:38.853891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842064+0000","last_change":"2024-09-12T21:50:38.842064+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842064+0000","last_undegraded":"2024-09-12T21:50:38.842064+0000","last_fullsized":"2024-09-12T21:50:38.842064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851954+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:38.851954+0000","last_peered":"2024-09-12T21:50:38.851954+0000","last_clean":"2024-09-12T21:50:38.851954+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:38.851954+0000","last_undegraded":"2024-09-12T21:50:38.851954+0000","last_fullsized":"2024-09-12T21:50:38.851954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:12.920344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.839970+0000","last_change":"2024-09-12T21:50:38.839970+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.839970+0000","last_undegraded":"2024-09-12T21:50:38.839970+0000","last_fullsized":"2024-09-12T21:50:38.839970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853214+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:38.853214+0000","last_peered":"2024-09-12T21:50:38.853214+0000","last_clean":"2024-09-12T21:50:38.853214+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:38.853214+0000","last_undegraded":"2024-09-12T21:50:38.853214+0000","last_fullsized":"2024-09-12T21:50:38.853214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842013+0000","last_change":"2024-09-12T21:50:38.842013+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842013+0000","last_undegraded":"2024-09-12T21:50:38.842013+0000","last_fullsized":"2024-09-12T21:50:38.842013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853312+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:38.853312+0000","last_peered":"2024-09-12T21:50:38.853312+0000","last_clean":"2024-09-12T21:50:38.853312+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:38.853312+0000","last_undegraded":"2024-09-12T21:50:38.853312+0000","last_fullsized":"2024-09-12T21:50:38.853312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842572+0000', 'last_change': '2024-09-12T21:50:38.842572+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842572+0000', 'last_undegraded': '2024-09-12T21:50:38.842572+0000', 'last_fullsized': '2024-09-12T21:50:38.842572+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842829+0000', 'last_change': '2024-09-12T21:50:38.842829+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842829+0000', 'last_undegraded': '2024-09-12T21:50:38.842829+0000', 'last_fullsized': '2024-09-12T21:50:38.842829+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844581+0000', 'last_change': '2024-09-12T21:50:38.844581+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844581+0000', 'last_undegraded': '2024-09-12T21:50:38.844581+0000', 'last_fullsized': '2024-09-12T21:50:38.844581+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844617+0000', 'last_change': '2024-09-12T21:50:38.844617+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844617+0000', 'last_undegraded': '2024-09-12T21:50:38.844617+0000', 'last_fullsized': '2024-09-12T21:50:38.844617+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.524 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840148+0000', 'last_change': '2024-09-12T21:50:38.840148+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840148+0000', 'last_undegraded': '2024-09-12T21:50:38.840148+0000', 'last_fullsized': '2024-09-12T21:50:38.840148+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844355+0000', 'last_change': '2024-09-12T21:50:38.844355+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844355+0000', 'last_undegraded': '2024-09-12T21:50:38.844355+0000', 'last_fullsized': '2024-09-12T21:50:38.844355+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843802+0000', 'last_change': '2024-09-12T21:50:38.843802+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843802+0000', 'last_undegraded': '2024-09-12T21:50:38.843802+0000', 'last_fullsized': '2024-09-12T21:50:38.843802+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844006+0000', 'last_change': '2024-09-12T21:50:38.844006+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844006+0000', 'last_undegraded': '2024-09-12T21:50:38.844006+0000', 'last_fullsized': '2024-09-12T21:50:38.844006+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.525 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844617+0000', 'last_change': '2024-09-12T21:50:38.844617+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844617+0000', 'last_undegraded': '2024-09-12T21:50:38.844617+0000', 'last_fullsized': '2024-09-12T21:50:38.844617+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842159+0000', 'last_change': '2024-09-12T21:50:38.842159+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842159+0000', 'last_undegraded': '2024-09-12T21:50:38.842159+0000', 'last_fullsized': '2024-09-12T21:50:38.842159+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843798+0000', 'last_change': '2024-09-12T21:50:38.843798+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843798+0000', 'last_undegraded': '2024-09-12T21:50:38.843798+0000', 'last_fullsized': '2024-09-12T21:50:38.843798+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842820+0000', 'last_change': '2024-09-12T21:50:38.842820+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842820+0000', 'last_undegraded': '2024-09-12T21:50:38.842820+0000', 'last_fullsized': '2024-09-12T21:50:38.842820+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842445+0000', 'last_change': '2024-09-12T21:50:38.842445+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842445+0000', 'last_undegraded': '2024-09-12T21:50:38.842445+0000', 'last_fullsized': '2024-09-12T21:50:38.842445+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842767+0000', 'last_change': '2024-09-12T21:50:38.842767+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842767+0000', 'last_undegraded': '2024-09-12T21:50:38.842767+0000', 'last_fullsized': '2024-09-12T21:50:38.842767+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.526 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842539+0000', 'last_change': '2024-09-12T21:50:38.842539+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842539+0000', 'last_undegraded': '2024-09-12T21:50:38.842539+0000', 'last_fullsized': '2024-09-12T21:50:38.842539+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843210+0000', 'last_change': '2024-09-12T21:50:38.843210+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843210+0000', 'last_undegraded': '2024-09-12T21:50:38.843210+0000', 'last_fullsized': '2024-09-12T21:50:38.843210+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844148+0000', 'last_change': '2024-09-12T21:50:38.844148+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844148+0000', 'last_undegraded': '2024-09-12T21:50:38.844148+0000', 'last_fullsized': '2024-09-12T21:50:38.844148+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840296+0000', 'last_change': '2024-09-12T21:50:38.840296+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840296+0000', 'last_undegraded': '2024-09-12T21:50:38.840296+0000', 'last_fullsized': '2024-09-12T21:50:38.840296+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844191+0000', 'last_change': '2024-09-12T21:50:38.844191+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844191+0000', 'last_undegraded': '2024-09-12T21:50:38.844191+0000', 'last_fullsized': '2024-09-12T21:50:38.844191+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-12T21:50:43.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842890+0000', 'last_change': '2024-09-12T21:50:38.842890+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842890+0000', 'last_undegraded': '2024-09-12T21:50:38.842890+0000', 'last_fullsized': '2024-09-12T21:50:38.842890+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843166+0000', 'last_change': '2024-09-12T21:50:38.843166+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843166+0000', 'last_undegraded': '2024-09-12T21:50:38.843166+0000', 'last_fullsized': '2024-09-12T21:50:38.843166+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842052+0000', 'last_change': '2024-09-12T21:50:38.842052+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842052+0000', 'last_undegraded': '2024-09-12T21:50:38.842052+0000', 'last_fullsized': '2024-09-12T21:50:38.842052+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.844005+0000', 'last_change': '2024-09-12T21:50:38.844005+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.844005+0000', 'last_undegraded': '2024-09-12T21:50:38.844005+0000', 'last_fullsized': '2024-09-12T21:50:38.844005+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841746+0000', 'last_change': '2024-09-12T21:50:38.841746+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841746+0000', 'last_undegraded': '2024-09-12T21:50:38.841746+0000', 'last_fullsized': '2024-09-12T21:50:38.841746+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841278+0000', 'last_change': '2024-09-12T21:50:38.841278+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841278+0000', 'last_undegraded': '2024-09-12T21:50:38.841278+0000', 'last_fullsized': '2024-09-12T21:50:38.841278+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-09-12T21:50:43.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843985+0000', 'last_change': '2024-09-12T21:50:38.843985+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843985+0000', 'last_undegraded': '2024-09-12T21:50:38.843985+0000', 'last_fullsized': '2024-09-12T21:50:38.843985+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843280+0000', 'last_change': '2024-09-12T21:50:38.843280+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843280+0000', 'last_undegraded': '2024-09-12T21:50:38.843280+0000', 'last_fullsized': '2024-09-12T21:50:38.843280+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840093+0000', 'last_change': '2024-09-12T21:50:38.840093+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840093+0000', 'last_undegraded': '2024-09-12T21:50:38.840093+0000', 'last_fullsized': '2024-09-12T21:50:38.840093+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843793+0000', 'last_change': '2024-09-12T21:50:38.843793+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843793+0000', 'last_undegraded': '2024-09-12T21:50:38.843793+0000', 'last_fullsized': '2024-09-12T21:50:38.843793+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840111+0000', 'last_change': '2024-09-12T21:50:38.840111+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840111+0000', 'last_undegraded': '2024-09-12T21:50:38.840111+0000', 'last_fullsized': '2024-09-12T21:50:38.840111+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843583+0000', 'last_change': '2024-09-12T21:50:38.843583+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843583+0000', 'last_undegraded': '2024-09-12T21:50:38.843583+0000', 'last_fullsized': '2024-09-12T21:50:38.843583+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-12T21:50:43.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842721+0000', 'last_change': '2024-09-12T21:50:38.842721+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842721+0000', 'last_undegraded': '2024-09-12T21:50:38.842721+0000', 'last_fullsized': '2024-09-12T21:50:38.842721+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841149+0000', 'last_change': '2024-09-12T21:50:38.841149+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841149+0000', 'last_undegraded': '2024-09-12T21:50:38.841149+0000', 'last_fullsized': '2024-09-12T21:50:38.841149+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840172+0000', 'last_change': '2024-09-12T21:50:38.840172+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840172+0000', 'last_undegraded': '2024-09-12T21:50:38.840172+0000', 'last_fullsized': '2024-09-12T21:50:38.840172+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842956+0000', 'last_change': '2024-09-12T21:50:38.842956+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842956+0000', 'last_undegraded': '2024-09-12T21:50:38.842956+0000', 'last_fullsized': '2024-09-12T21:50:38.842956+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843413+0000', 'last_change': '2024-09-12T21:50:38.843413+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843413+0000', 'last_undegraded': '2024-09-12T21:50:38.843413+0000', 'last_fullsized': '2024-09-12T21:50:38.843413+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840162+0000', 'last_change': '2024-09-12T21:50:38.840162+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840162+0000', 'last_undegraded': '2024-09-12T21:50:38.840162+0000', 'last_fullsized': '2024-09-12T21:50:38.840162+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T21:50:43.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842083+0000', 'last_change': '2024-09-12T21:50:38.842083+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842083+0000', 'last_undegraded': '2024-09-12T21:50:38.842083+0000', 'last_fullsized': '2024-09-12T21:50:38.842083+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840603+0000', 'last_change': '2024-09-12T21:50:38.840603+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840603+0000', 'last_undegraded': '2024-09-12T21:50:38.840603+0000', 'last_fullsized': '2024-09-12T21:50:38.840603+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842316+0000', 'last_change': '2024-09-12T21:50:38.842316+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842316+0000', 'last_undegraded': '2024-09-12T21:50:38.842316+0000', 'last_fullsized': '2024-09-12T21:50:38.842316+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842217+0000', 'last_change': '2024-09-12T21:50:38.842217+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842217+0000', 'last_undegraded': '2024-09-12T21:50:38.842217+0000', 'last_fullsized': '2024-09-12T21:50:38.842217+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842798+0000', 'last_change': '2024-09-12T21:50:38.842798+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842798+0000', 'last_undegraded': '2024-09-12T21:50:38.842798+0000', 'last_fullsized': '2024-09-12T21:50:38.842798+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841135+0000', 'last_change': '2024-09-12T21:50:38.841135+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841135+0000', 'last_undegraded': '2024-09-12T21:50:38.841135+0000', 'last_fullsized': '2024-09-12T21:50:38.841135+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-12T21:50:43.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842845+0000', 'last_change': '2024-09-12T21:50:38.842845+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842845+0000', 'last_undegraded': '2024-09-12T21:50:38.842845+0000', 'last_fullsized': '2024-09-12T21:50:38.842845+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842077+0000', 'last_change': '2024-09-12T21:50:38.842077+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842077+0000', 'last_undegraded': '2024-09-12T21:50:38.842077+0000', 'last_fullsized': '2024-09-12T21:50:38.842077+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841264+0000', 'last_change': '2024-09-12T21:50:38.841264+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841264+0000', 'last_undegraded': '2024-09-12T21:50:38.841264+0000', 'last_fullsized': '2024-09-12T21:50:38.841264+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842331+0000', 'last_change': '2024-09-12T21:50:38.842331+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842331+0000', 'last_undegraded': '2024-09-12T21:50:38.842331+0000', 'last_fullsized': '2024-09-12T21:50:38.842331+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842297+0000', 'last_change': '2024-09-12T21:50:38.842297+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842297+0000', 'last_undegraded': '2024-09-12T21:50:38.842297+0000', 'last_fullsized': '2024-09-12T21:50:38.842297+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841197+0000', 'last_change': '2024-09-12T21:50:38.841197+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841197+0000', 'last_undegraded': '2024-09-12T21:50:38.841197+0000', 'last_fullsized': '2024-09-12T21:50:38.841197+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.532 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841695+0000', 'last_change': '2024-09-12T21:50:38.841695+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841695+0000', 'last_undegraded': '2024-09-12T21:50:38.841695+0000', 'last_fullsized': '2024-09-12T21:50:38.841695+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842361+0000', 'last_change': '2024-09-12T21:50:38.842361+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842361+0000', 'last_undegraded': '2024-09-12T21:50:38.842361+0000', 'last_fullsized': '2024-09-12T21:50:38.842361+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841081+0000', 'last_change': '2024-09-12T21:50:38.841081+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841081+0000', 'last_undegraded': '2024-09-12T21:50:38.841081+0000', 'last_fullsized': '2024-09-12T21:50:38.841081+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841605+0000', 'last_change': '2024-09-12T21:50:38.841605+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841605+0000', 'last_undegraded': '2024-09-12T21:50:38.841605+0000', 'last_fullsized': '2024-09-12T21:50:38.841605+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842952+0000', 'last_change': '2024-09-12T21:50:38.842952+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842952+0000', 'last_undegraded': '2024-09-12T21:50:38.842952+0000', 'last_fullsized': '2024-09-12T21:50:38.842952+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-12T21:50:43.533 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842945+0000', 'last_change': '2024-09-12T21:50:38.842945+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842945+0000', 'last_undegraded': '2024-09-12T21:50:38.842945+0000', 'last_fullsized': '2024-09-12T21:50:38.842945+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843004+0000', 'last_change': '2024-09-12T21:50:38.843004+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843004+0000', 'last_undegraded': '2024-09-12T21:50:38.843004+0000', 'last_fullsized': '2024-09-12T21:50:38.843004+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.840289+0000', 'last_change': '2024-09-12T21:50:38.840289+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.840289+0000', 'last_undegraded': '2024-09-12T21:50:38.840289+0000', 'last_fullsized': '2024-09-12T21:50:38.840289+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.843558+0000', 'last_change': '2024-09-12T21:50:38.843558+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.843558+0000', 'last_undegraded': '2024-09-12T21:50:38.843558+0000', 'last_fullsized': '2024-09-12T21:50:38.843558+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.841165+0000', 'last_change': '2024-09-12T21:50:38.841165+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.841165+0000', 'last_undegraded': '2024-09-12T21:50:38.841165+0000', 'last_fullsized': '2024-09-12T21:50:38.841165+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T21:50:43.534 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842078+0000', 'last_change': '2024-09-12T21:50:38.842078+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842078+0000', 'last_undegraded': '2024-09-12T21:50:38.842078+0000', 'last_fullsized': '2024-09-12T21:50:38.842078+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842545+0000', 'last_change': '2024-09-12T21:50:38.842545+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842545+0000', 'last_undegraded': '2024-09-12T21:50:38.842545+0000', 'last_fullsized': '2024-09-12T21:50:38.842545+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842064+0000', 'last_change': '2024-09-12T21:50:38.842064+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842064+0000', 'last_undegraded': '2024-09-12T21:50:38.842064+0000', 'last_fullsized': '2024-09-12T21:50:38.842064+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.839970+0000', 'last_change': '2024-09-12T21:50:38.839970+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.839970+0000', 'last_undegraded': '2024-09-12T21:50:38.839970+0000', 'last_fullsized': '2024-09-12T21:50:38.839970+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T21:50:43.535 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T21:50:38.842013+0000', 'last_change': '2024-09-12T21:50:38.842013+0000', 'last_active': '2024-09-12T21:50:38.831158+0000', 'last_peered': '2024-09-12T21:50:38.831158+0000', 'last_clean': '2024-09-12T21:50:38.831158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T21:50:38.842013+0000', 'last_undegraded': '2024-09-12T21:50:38.842013+0000', 'last_fullsized': '2024-09-12T21:50:38.842013+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'last_clean_scrub_stamp': '2024-09-12T21:50:38.831158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T21:50:43.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T21:50:43.918 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:43.919 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":3,"num_up_osds":3,"osd_up_since":1726177828,"num_in_osds":3,"osd_in_since":1726177819,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":88924160,"bytes_avail":289821368320,"bytes_total":289910292480,"inactive_pgs_ratio":0.60952383279800415,"write_bytes_sec":407,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4233}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T21:50:18.608857+0000","services":{}},"progress_events":{}} 2024-09-12T21:50:43.931 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T21:50:43.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:44.222 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:44.224 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:44.233 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T21:50:43.399795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86840,"kb_used_data":1576,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028680,"statfs":{"total":289910292480,"available":289821368320,"internally_reserved":0,"allocated":1613824,"data_stored":1315003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.561439"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842572+0000","last_change":"2024-09-12T21:50:38.842572+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842572+0000","last_undegraded":"2024-09-12T21:50:38.842572+0000","last_fullsized":"2024-09-12T21:50:38.842572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842829+0000","last_change":"2024-09-12T21:50:38.842829+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842829+0000","last_undegraded":"2024-09-12T21:50:38.842829+0000","last_fullsized":"2024-09-12T21:50:38.842829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844581+0000","last_change":"2024-09-12T21:50:38.844581+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844581+0000","last_undegraded":"2024-09-12T21:50:38.844581+0000","last_fullsized":"2024-09-12T21:50:38.844581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840148+0000","last_change":"2024-09-12T21:50:38.840148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840148+0000","last_undegraded":"2024-09-12T21:50:38.840148+0000","last_fullsized":"2024-09-12T21:50:38.840148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844355+0000","last_change":"2024-09-12T21:50:38.844355+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844355+0000","last_undegraded":"2024-09-12T21:50:38.844355+0000","last_fullsized":"2024-09-12T21:50:38.844355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843802+0000","last_change":"2024-09-12T21:50:38.843802+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843802+0000","last_undegraded":"2024-09-12T21:50:38.843802+0000","last_fullsized":"2024-09-12T21:50:38.843802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844006+0000","last_change":"2024-09-12T21:50:38.844006+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844006+0000","last_undegraded":"2024-09-12T21:50:38.844006+0000","last_fullsized":"2024-09-12T21:50:38.844006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844617+0000","last_change":"2024-09-12T21:50:38.844617+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844617+0000","last_undegraded":"2024-09-12T21:50:38.844617+0000","last_fullsized":"2024-09-12T21:50:38.844617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842159+0000","last_change":"2024-09-12T21:50:38.842159+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842159+0000","last_undegraded":"2024-09-12T21:50:38.842159+0000","last_fullsized":"2024-09-12T21:50:38.842159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843798+0000","last_change":"2024-09-12T21:50:38.843798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843798+0000","last_undegraded":"2024-09-12T21:50:38.843798+0000","last_fullsized":"2024-09-12T21:50:38.843798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842820+0000","last_change":"2024-09-12T21:50:38.842820+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842820+0000","last_undegraded":"2024-09-12T21:50:38.842820+0000","last_fullsized":"2024-09-12T21:50:38.842820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842445+0000","last_change":"2024-09-12T21:50:38.842445+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842445+0000","last_undegraded":"2024-09-12T21:50:38.842445+0000","last_fullsized":"2024-09-12T21:50:38.842445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842767+0000","last_change":"2024-09-12T21:50:38.842767+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842767+0000","last_undegraded":"2024-09-12T21:50:38.842767+0000","last_fullsized":"2024-09-12T21:50:38.842767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842539+0000","last_change":"2024-09-12T21:50:38.842539+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842539+0000","last_undegraded":"2024-09-12T21:50:38.842539+0000","last_fullsized":"2024-09-12T21:50:38.842539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843210+0000","last_change":"2024-09-12T21:50:38.843210+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843210+0000","last_undegraded":"2024-09-12T21:50:38.843210+0000","last_fullsized":"2024-09-12T21:50:38.843210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844148+0000","last_change":"2024-09-12T21:50:38.844148+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844148+0000","last_undegraded":"2024-09-12T21:50:38.844148+0000","last_fullsized":"2024-09-12T21:50:38.844148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840296+0000","last_change":"2024-09-12T21:50:38.840296+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840296+0000","last_undegraded":"2024-09-12T21:50:38.840296+0000","last_fullsized":"2024-09-12T21:50:38.840296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844191+0000","last_change":"2024-09-12T21:50:38.844191+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844191+0000","last_undegraded":"2024-09-12T21:50:38.844191+0000","last_fullsized":"2024-09-12T21:50:38.844191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842890+0000","last_change":"2024-09-12T21:50:38.842890+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842890+0000","last_undegraded":"2024-09-12T21:50:38.842890+0000","last_fullsized":"2024-09-12T21:50:38.842890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843166+0000","last_change":"2024-09-12T21:50:38.843166+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843166+0000","last_undegraded":"2024-09-12T21:50:38.843166+0000","last_fullsized":"2024-09-12T21:50:38.843166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842052+0000","last_change":"2024-09-12T21:50:38.842052+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842052+0000","last_undegraded":"2024-09-12T21:50:38.842052+0000","last_fullsized":"2024-09-12T21:50:38.842052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.844005+0000","last_change":"2024-09-12T21:50:38.844005+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.844005+0000","last_undegraded":"2024-09-12T21:50:38.844005+0000","last_fullsized":"2024-09-12T21:50:38.844005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841746+0000","last_change":"2024-09-12T21:50:38.841746+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841746+0000","last_undegraded":"2024-09-12T21:50:38.841746+0000","last_fullsized":"2024-09-12T21:50:38.841746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841278+0000","last_change":"2024-09-12T21:50:38.841278+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841278+0000","last_undegraded":"2024-09-12T21:50:38.841278+0000","last_fullsized":"2024-09-12T21:50:38.841278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843985+0000","last_change":"2024-09-12T21:50:38.843985+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843985+0000","last_undegraded":"2024-09-12T21:50:38.843985+0000","last_fullsized":"2024-09-12T21:50:38.843985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843280+0000","last_change":"2024-09-12T21:50:38.843280+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843280+0000","last_undegraded":"2024-09-12T21:50:38.843280+0000","last_fullsized":"2024-09-12T21:50:38.843280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840093+0000","last_change":"2024-09-12T21:50:38.840093+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840093+0000","last_undegraded":"2024-09-12T21:50:38.840093+0000","last_fullsized":"2024-09-12T21:50:38.840093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843793+0000","last_change":"2024-09-12T21:50:38.843793+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843793+0000","last_undegraded":"2024-09-12T21:50:38.843793+0000","last_fullsized":"2024-09-12T21:50:38.843793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840111+0000","last_change":"2024-09-12T21:50:38.840111+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840111+0000","last_undegraded":"2024-09-12T21:50:38.840111+0000","last_fullsized":"2024-09-12T21:50:38.840111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843583+0000","last_change":"2024-09-12T21:50:38.843583+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843583+0000","last_undegraded":"2024-09-12T21:50:38.843583+0000","last_fullsized":"2024-09-12T21:50:38.843583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842721+0000","last_change":"2024-09-12T21:50:38.842721+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842721+0000","last_undegraded":"2024-09-12T21:50:38.842721+0000","last_fullsized":"2024-09-12T21:50:38.842721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841149+0000","last_change":"2024-09-12T21:50:38.841149+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841149+0000","last_undegraded":"2024-09-12T21:50:38.841149+0000","last_fullsized":"2024-09-12T21:50:38.841149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853177+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:38.853177+0000","last_peered":"2024-09-12T21:50:38.853177+0000","last_clean":"2024-09-12T21:50:38.853177+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:38.853177+0000","last_undegraded":"2024-09-12T21:50:38.853177+0000","last_fullsized":"2024-09-12T21:50:38.853177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840172+0000","last_change":"2024-09-12T21:50:38.840172+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840172+0000","last_undegraded":"2024-09-12T21:50:38.840172+0000","last_fullsized":"2024-09-12T21:50:38.840172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853307+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:38.853307+0000","last_peered":"2024-09-12T21:50:38.853307+0000","last_clean":"2024-09-12T21:50:38.853307+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:38.853307+0000","last_undegraded":"2024-09-12T21:50:38.853307+0000","last_fullsized":"2024-09-12T21:50:38.853307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842956+0000","last_change":"2024-09-12T21:50:38.842956+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842956+0000","last_undegraded":"2024-09-12T21:50:38.842956+0000","last_fullsized":"2024-09-12T21:50:38.842956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852002+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:38.852002+0000","last_peered":"2024-09-12T21:50:38.852002+0000","last_clean":"2024-09-12T21:50:38.852002+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:38.852002+0000","last_undegraded":"2024-09-12T21:50:38.852002+0000","last_fullsized":"2024-09-12T21:50:38.852002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:13.063934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843413+0000","last_change":"2024-09-12T21:50:38.843413+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843413+0000","last_undegraded":"2024-09-12T21:50:38.843413+0000","last_fullsized":"2024-09-12T21:50:38.843413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860027+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:38.860027+0000","last_peered":"2024-09-12T21:50:38.860027+0000","last_clean":"2024-09-12T21:50:38.860027+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:38.860027+0000","last_undegraded":"2024-09-12T21:50:38.860027+0000","last_fullsized":"2024-09-12T21:50:38.860027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859991+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:38.859991+0000","last_peered":"2024-09-12T21:50:38.859991+0000","last_clean":"2024-09-12T21:50:38.859991+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:38.859991+0000","last_undegraded":"2024-09-12T21:50:38.859991+0000","last_fullsized":"2024-09-12T21:50:38.859991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840162+0000","last_change":"2024-09-12T21:50:38.840162+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840162+0000","last_undegraded":"2024-09-12T21:50:38.840162+0000","last_fullsized":"2024-09-12T21:50:38.840162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851974+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:38.851974+0000","last_peered":"2024-09-12T21:50:38.851974+0000","last_clean":"2024-09-12T21:50:38.851974+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:38.851974+0000","last_undegraded":"2024-09-12T21:50:38.851974+0000","last_fullsized":"2024-09-12T21:50:38.851974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.180337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842083+0000","last_change":"2024-09-12T21:50:38.842083+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842083+0000","last_undegraded":"2024-09-12T21:50:38.842083+0000","last_fullsized":"2024-09-12T21:50:38.842083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.860025+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:38.860025+0000","last_peered":"2024-09-12T21:50:38.860025+0000","last_clean":"2024-09-12T21:50:38.860025+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:38.860025+0000","last_undegraded":"2024-09-12T21:50:38.860025+0000","last_fullsized":"2024-09-12T21:50:38.860025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840603+0000","last_change":"2024-09-12T21:50:38.840603+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840603+0000","last_undegraded":"2024-09-12T21:50:38.840603+0000","last_fullsized":"2024-09-12T21:50:38.840603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853293+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:38.853293+0000","last_peered":"2024-09-12T21:50:38.853293+0000","last_clean":"2024-09-12T21:50:38.853293+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:38.853293+0000","last_undegraded":"2024-09-12T21:50:38.853293+0000","last_fullsized":"2024-09-12T21:50:38.853293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842316+0000","last_change":"2024-09-12T21:50:38.842316+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842316+0000","last_undegraded":"2024-09-12T21:50:38.842316+0000","last_fullsized":"2024-09-12T21:50:38.842316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853283+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:38.853283+0000","last_peered":"2024-09-12T21:50:38.853283+0000","last_clean":"2024-09-12T21:50:38.853283+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:38.853283+0000","last_undegraded":"2024-09-12T21:50:38.853283+0000","last_fullsized":"2024-09-12T21:50:38.853283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842217+0000","last_change":"2024-09-12T21:50:38.842217+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842217+0000","last_undegraded":"2024-09-12T21:50:38.842217+0000","last_fullsized":"2024-09-12T21:50:38.842217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853010+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:38.853010+0000","last_peered":"2024-09-12T21:50:38.853010+0000","last_clean":"2024-09-12T21:50:38.853010+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:38.853010+0000","last_undegraded":"2024-09-12T21:50:38.853010+0000","last_fullsized":"2024-09-12T21:50:38.853010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842798+0000","last_change":"2024-09-12T21:50:38.842798+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842798+0000","last_undegraded":"2024-09-12T21:50:38.842798+0000","last_fullsized":"2024-09-12T21:50:38.842798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851917+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:38.851917+0000","last_peered":"2024-09-12T21:50:38.851917+0000","last_clean":"2024-09-12T21:50:38.851917+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:38.851917+0000","last_undegraded":"2024-09-12T21:50:38.851917+0000","last_fullsized":"2024-09-12T21:50:38.851917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:54.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841135+0000","last_change":"2024-09-12T21:50:38.841135+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841135+0000","last_undegraded":"2024-09-12T21:50:38.841135+0000","last_fullsized":"2024-09-12T21:50:38.841135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852221+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:38.852221+0000","last_peered":"2024-09-12T21:50:38.852221+0000","last_clean":"2024-09-12T21:50:38.852221+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:38.852221+0000","last_undegraded":"2024-09-12T21:50:38.852221+0000","last_fullsized":"2024-09-12T21:50:38.852221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842845+0000","last_change":"2024-09-12T21:50:38.842845+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842845+0000","last_undegraded":"2024-09-12T21:50:38.842845+0000","last_fullsized":"2024-09-12T21:50:38.842845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845219+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:38.845219+0000","last_peered":"2024-09-12T21:50:38.845219+0000","last_clean":"2024-09-12T21:50:38.845219+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:38.845219+0000","last_undegraded":"2024-09-12T21:50:38.845219+0000","last_fullsized":"2024-09-12T21:50:38.845219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":24,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845559+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:38.845559+0000","last_peered":"2024-09-12T21:50:38.845559+0000","last_clean":"2024-09-12T21:50:38.845559+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:38.845559+0000","last_undegraded":"2024-09-12T21:50:38.845559+0000","last_fullsized":"2024-09-12T21:50:38.845559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853197+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:38.853197+0000","last_peered":"2024-09-12T21:50:38.853197+0000","last_clean":"2024-09-12T21:50:38.853197+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:38.853197+0000","last_undegraded":"2024-09-12T21:50:38.853197+0000","last_fullsized":"2024-09-12T21:50:38.853197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842077+0000","last_change":"2024-09-12T21:50:38.842077+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842077+0000","last_undegraded":"2024-09-12T21:50:38.842077+0000","last_fullsized":"2024-09-12T21:50:38.842077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845178+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:38.845178+0000","last_peered":"2024-09-12T21:50:38.845178+0000","last_clean":"2024-09-12T21:50:38.845178+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:38.845178+0000","last_undegraded":"2024-09-12T21:50:38.845178+0000","last_fullsized":"2024-09-12T21:50:38.845178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853126+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:38.853126+0000","last_peered":"2024-09-12T21:50:38.853126+0000","last_clean":"2024-09-12T21:50:38.853126+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:38.853126+0000","last_undegraded":"2024-09-12T21:50:38.853126+0000","last_fullsized":"2024-09-12T21:50:38.853126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841264+0000","last_change":"2024-09-12T21:50:38.841264+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841264+0000","last_undegraded":"2024-09-12T21:50:38.841264+0000","last_fullsized":"2024-09-12T21:50:38.841264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840136+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:38.840136+0000","last_peered":"2024-09-12T21:50:38.840136+0000","last_clean":"2024-09-12T21:50:38.840136+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:38.840136+0000","last_undegraded":"2024-09-12T21:50:38.840136+0000","last_fullsized":"2024-09-12T21:50:38.840136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851998+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:38.851998+0000","last_peered":"2024-09-12T21:50:38.851998+0000","last_clean":"2024-09-12T21:50:38.851998+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:38.851998+0000","last_undegraded":"2024-09-12T21:50:38.851998+0000","last_fullsized":"2024-09-12T21:50:38.851998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.034144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842331+0000","last_change":"2024-09-12T21:50:38.842331+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842331+0000","last_undegraded":"2024-09-12T21:50:38.842331+0000","last_fullsized":"2024-09-12T21:50:38.842331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845352+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:38.845352+0000","last_peered":"2024-09-12T21:50:38.845352+0000","last_clean":"2024-09-12T21:50:38.845352+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:38.845352+0000","last_undegraded":"2024-09-12T21:50:38.845352+0000","last_fullsized":"2024-09-12T21:50:38.845352+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853958+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:38.853958+0000","last_peered":"2024-09-12T21:50:38.853958+0000","last_clean":"2024-09-12T21:50:38.853958+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:38.853958+0000","last_undegraded":"2024-09-12T21:50:38.853958+0000","last_fullsized":"2024-09-12T21:50:38.853958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842297+0000","last_change":"2024-09-12T21:50:38.842297+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842297+0000","last_undegraded":"2024-09-12T21:50:38.842297+0000","last_fullsized":"2024-09-12T21:50:38.842297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853510+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:38.853510+0000","last_peered":"2024-09-12T21:50:38.853510+0000","last_clean":"2024-09-12T21:50:38.853510+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:38.853510+0000","last_undegraded":"2024-09-12T21:50:38.853510+0000","last_fullsized":"2024-09-12T21:50:38.853510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.839925+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:38.839925+0000","last_peered":"2024-09-12T21:50:38.839925+0000","last_clean":"2024-09-12T21:50:38.839925+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:38.839925+0000","last_undegraded":"2024-09-12T21:50:38.839925+0000","last_fullsized":"2024-09-12T21:50:38.839925+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841197+0000","last_change":"2024-09-12T21:50:38.841197+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841197+0000","last_undegraded":"2024-09-12T21:50:38.841197+0000","last_fullsized":"2024-09-12T21:50:38.841197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855572+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:38.855572+0000","last_peered":"2024-09-12T21:50:38.855572+0000","last_clean":"2024-09-12T21:50:38.855572+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:38.855572+0000","last_undegraded":"2024-09-12T21:50:38.855572+0000","last_fullsized":"2024-09-12T21:50:38.855572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845021+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:38.845021+0000","last_peered":"2024-09-12T21:50:38.845021+0000","last_clean":"2024-09-12T21:50:38.845021+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:38.845021+0000","last_undegraded":"2024-09-12T21:50:38.845021+0000","last_fullsized":"2024-09-12T21:50:38.845021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841695+0000","last_change":"2024-09-12T21:50:38.841695+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841695+0000","last_undegraded":"2024-09-12T21:50:38.841695+0000","last_fullsized":"2024-09-12T21:50:38.841695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855601+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:38.855601+0000","last_peered":"2024-09-12T21:50:38.855601+0000","last_clean":"2024-09-12T21:50:38.855601+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:38.855601+0000","last_undegraded":"2024-09-12T21:50:38.855601+0000","last_fullsized":"2024-09-12T21:50:38.855601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.840469+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:38.840469+0000","last_peered":"2024-09-12T21:50:38.840469+0000","last_clean":"2024-09-12T21:50:38.840469+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:38.840469+0000","last_undegraded":"2024-09-12T21:50:38.840469+0000","last_fullsized":"2024-09-12T21:50:38.840469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842361+0000","last_change":"2024-09-12T21:50:38.842361+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842361+0000","last_undegraded":"2024-09-12T21:50:38.842361+0000","last_fullsized":"2024-09-12T21:50:38.842361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853308+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:38.853308+0000","last_peered":"2024-09-12T21:50:38.853308+0000","last_clean":"2024-09-12T21:50:38.853308+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:38.853308+0000","last_undegraded":"2024-09-12T21:50:38.853308+0000","last_fullsized":"2024-09-12T21:50:38.853308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.845882+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:38.845882+0000","last_peered":"2024-09-12T21:50:38.845882+0000","last_clean":"2024-09-12T21:50:38.845882+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:38.845882+0000","last_undegraded":"2024-09-12T21:50:38.845882+0000","last_fullsized":"2024-09-12T21:50:38.845882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841081+0000","last_change":"2024-09-12T21:50:38.841081+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841081+0000","last_undegraded":"2024-09-12T21:50:38.841081+0000","last_fullsized":"2024-09-12T21:50:38.841081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841605+0000","last_change":"2024-09-12T21:50:38.841605+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841605+0000","last_undegraded":"2024-09-12T21:50:38.841605+0000","last_fullsized":"2024-09-12T21:50:38.841605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.859987+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:38.859987+0000","last_peered":"2024-09-12T21:50:38.859987+0000","last_clean":"2024-09-12T21:50:38.859987+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:38.859987+0000","last_undegraded":"2024-09-12T21:50:38.859987+0000","last_fullsized":"2024-09-12T21:50:38.859987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:39.214292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842952+0000","last_change":"2024-09-12T21:50:38.842952+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842952+0000","last_undegraded":"2024-09-12T21:50:38.842952+0000","last_fullsized":"2024-09-12T21:50:38.842952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.852016+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:38.852016+0000","last_peered":"2024-09-12T21:50:38.852016+0000","last_clean":"2024-09-12T21:50:38.852016+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:38.852016+0000","last_undegraded":"2024-09-12T21:50:38.852016+0000","last_fullsized":"2024-09-12T21:50:38.852016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:37.497140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.857032+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:38.857032+0000","last_peered":"2024-09-12T21:50:38.857032+0000","last_clean":"2024-09-12T21:50:38.857032+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:38.857032+0000","last_undegraded":"2024-09-12T21:50:38.857032+0000","last_fullsized":"2024-09-12T21:50:38.857032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842945+0000","last_change":"2024-09-12T21:50:38.842945+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842945+0000","last_undegraded":"2024-09-12T21:50:38.842945+0000","last_fullsized":"2024-09-12T21:50:38.842945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.855624+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:38.855624+0000","last_peered":"2024-09-12T21:50:38.855624+0000","last_clean":"2024-09-12T21:50:38.855624+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:38.855624+0000","last_undegraded":"2024-09-12T21:50:38.855624+0000","last_fullsized":"2024-09-12T21:50:38.855624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:09.809181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843004+0000","last_change":"2024-09-12T21:50:38.843004+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843004+0000","last_undegraded":"2024-09-12T21:50:38.843004+0000","last_fullsized":"2024-09-12T21:50:38.843004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.840289+0000","last_change":"2024-09-12T21:50:38.840289+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.840289+0000","last_undegraded":"2024-09-12T21:50:38.840289+0000","last_fullsized":"2024-09-12T21:50:38.840289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853186+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:38.853186+0000","last_peered":"2024-09-12T21:50:38.853186+0000","last_clean":"2024-09-12T21:50:38.853186+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:38.853186+0000","last_undegraded":"2024-09-12T21:50:38.853186+0000","last_fullsized":"2024-09-12T21:50:38.853186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:35.101211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.843558+0000","last_change":"2024-09-12T21:50:38.843558+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.843558+0000","last_undegraded":"2024-09-12T21:50:38.843558+0000","last_fullsized":"2024-09-12T21:50:38.843558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853265+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:38.853265+0000","last_peered":"2024-09-12T21:50:38.853265+0000","last_clean":"2024-09-12T21:50:38.853265+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:38.853265+0000","last_undegraded":"2024-09-12T21:50:38.853265+0000","last_fullsized":"2024-09-12T21:50:38.853265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.841165+0000","last_change":"2024-09-12T21:50:38.841165+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.841165+0000","last_undegraded":"2024-09-12T21:50:38.841165+0000","last_fullsized":"2024-09-12T21:50:38.841165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851930+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:38.851930+0000","last_peered":"2024-09-12T21:50:38.851930+0000","last_clean":"2024-09-12T21:50:38.851930+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:38.851930+0000","last_undegraded":"2024-09-12T21:50:38.851930+0000","last_fullsized":"2024-09-12T21:50:38.851930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:26.477264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842078+0000","last_change":"2024-09-12T21:50:38.842078+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842078+0000","last_undegraded":"2024-09-12T21:50:38.842078+0000","last_fullsized":"2024-09-12T21:50:38.842078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851467+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:38.851467+0000","last_peered":"2024-09-12T21:50:38.851467+0000","last_clean":"2024-09-12T21:50:38.851467+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:38.851467+0000","last_undegraded":"2024-09-12T21:50:38.851467+0000","last_fullsized":"2024-09-12T21:50:38.851467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:15.075969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842545+0000","last_change":"2024-09-12T21:50:38.842545+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842545+0000","last_undegraded":"2024-09-12T21:50:38.842545+0000","last_fullsized":"2024-09-12T21:50:38.842545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853891+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:38.853891+0000","last_peered":"2024-09-12T21:50:38.853891+0000","last_clean":"2024-09-12T21:50:38.853891+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:38.853891+0000","last_undegraded":"2024-09-12T21:50:38.853891+0000","last_fullsized":"2024-09-12T21:50:38.853891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842064+0000","last_change":"2024-09-12T21:50:38.842064+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842064+0000","last_undegraded":"2024-09-12T21:50:38.842064+0000","last_fullsized":"2024-09-12T21:50:38.842064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.851954+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:38.851954+0000","last_peered":"2024-09-12T21:50:38.851954+0000","last_clean":"2024-09-12T21:50:38.851954+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:38.851954+0000","last_undegraded":"2024-09-12T21:50:38.851954+0000","last_fullsized":"2024-09-12T21:50:38.851954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:12.920344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.839970+0000","last_change":"2024-09-12T21:50:38.839970+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.839970+0000","last_undegraded":"2024-09-12T21:50:38.839970+0000","last_fullsized":"2024-09-12T21:50:38.839970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853214+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:38.853214+0000","last_peered":"2024-09-12T21:50:38.853214+0000","last_clean":"2024-09-12T21:50:38.853214+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:38.853214+0000","last_undegraded":"2024-09-12T21:50:38.853214+0000","last_fullsized":"2024-09-12T21:50:38.853214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T21:50:38.842013+0000","last_change":"2024-09-12T21:50:38.842013+0000","last_active":"2024-09-12T21:50:38.831158+0000","last_peered":"2024-09-12T21:50:38.831158+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:38.842013+0000","last_undegraded":"2024-09-12T21:50:38.842013+0000","last_fullsized":"2024-09-12T21:50:38.842013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T21:50:38.853312+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:38.853312+0000","last_peered":"2024-09-12T21:50:38.853312+0000","last_clean":"2024-09-12T21:50:38.853312+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:38.853312+0000","last_undegraded":"2024-09-12T21:50:38.853312+0000","last_fullsized":"2024-09-12T21:50:38.853312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":733184,"data_stored":635111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":44762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":737280,"data_stored":635130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:47.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:47.552 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:47.561 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T21:50:46.857952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1728,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1769472,"data_stored":1371148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.018262"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":794624,"data_stored":651803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:47.568 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T21:50:47.569 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T21:50:47.569 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T21:50:47.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T21:50:47.570 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T21:50:47.943 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:47.954 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3020436551},{"type":"v1","addr":"172.21.15.53:6801","nonce":3020436551}]},"active_addr":"172.21.15.53:6801/3020436551","active_change":"2024-09-12T21:50:22.849142+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1398775843}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":127209600}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":606041238}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":352523803}]}]} 2024-09-12T21:50:47.959 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T21:50:47.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T21:50:47.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:48.251 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:48.251 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:43.398142+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:48.264 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T21:50:48.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:48.557 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:48.558 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:43.398142+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:48.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T21:50:48.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T21:50:48.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T21:50:48.717 INFO:teuthology.orchestra.run.smithi053.stdout:34359738374 2024-09-12T21:50:48.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T21:50:48.720 INFO:teuthology.orchestra.run.smithi053.stdout:34359738375 2024-09-12T21:50:48.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T21:50:48.721 INFO:teuthology.orchestra.run.smithi053.stdout:34359738374 2024-09-12T21:50:48.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T21:50:49.014 INFO:teuthology.orchestra.run.smithi053.stdout:34359738373 2024-09-12T21:50:49.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-12T21:50:49.060 INFO:teuthology.orchestra.run.smithi053.stdout:34359738374 2024-09-12T21:50:49.066 INFO:teuthology.orchestra.run.smithi053.stdout:34359738373 2024-09-12T21:50:49.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-12T21:50:49.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-09-12T21:50:50.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T21:50:50.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T21:50:50.080 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T21:50:50.348 INFO:teuthology.orchestra.run.smithi053.stdout:34359738374 2024-09-12T21:50:50.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-12T21:50:50.366 DEBUG:teuthology.parallel:result is None 2024-09-12T21:50:50.392 INFO:teuthology.orchestra.run.smithi053.stdout:34359738375 2024-09-12T21:50:50.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-12T21:50:50.406 DEBUG:teuthology.parallel:result is None 2024-09-12T21:50:50.421 INFO:teuthology.orchestra.run.smithi053.stdout:34359738374 2024-09-12T21:50:50.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-09-12T21:50:50.434 DEBUG:teuthology.parallel:result is None 2024-09-12T21:50:50.435 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T21:50:50.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:50.768 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:50.770 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:50.779 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T21:50:48.858392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.011346"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:50.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:51.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T21:50:50.858946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002224"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:51.131 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T21:50:51.132 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T21:50:51.132 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T21:50:51.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T21:50:51.498 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:51.498 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T21:50:51.511 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T21:50:51.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:50:51.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:51.836 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:50:51.836 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:50:51.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:50:52.176 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:52.176 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:50:52.177 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:50:52.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:50:52.481 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:52.481 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:50:43.398142+0000","last_up_change":"2024-09-12T21:50:28.694982+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6801","nonce":2197885711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6803","nonce":2197885711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6807","nonce":2197885711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2197885711},{"type":"v1","addr":"172.21.15.89:6805","nonce":2197885711}]},"public_addr":"172.21.15.89:6801/2197885711","cluster_addr":"172.21.15.89:6803/2197885711","heartbeat_back_addr":"172.21.15.89:6807/2197885711","heartbeat_front_addr":"172.21.15.89:6805/2197885711","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6801","nonce":1685972058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6803","nonce":1685972058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6807","nonce":1685972058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1685972058},{"type":"v1","addr":"172.21.15.172:6805","nonce":1685972058}]},"public_addr":"172.21.15.172:6801/1685972058","cluster_addr":"172.21.15.172:6803/1685972058","heartbeat_back_addr":"172.21.15.172:6807/1685972058","heartbeat_front_addr":"172.21.15.172:6805/1685972058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:50:52.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:50:52.819 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:52.819 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:50:52.820 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:50:52.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T21:50:39.196391+0000', 'modified': '2024-09-12T21:50:41.193174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4233': {'gid': 4233, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.53:6803/112708667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6802', 'nonce': 112708667}, {'type': 'v1', 'addr': '172.21.15.53:6803', 'nonce': 112708667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4233, 'qdb_cluster': [4233]} 2024-09-12T21:50:52.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T21:50:52.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T21:50:53.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-12T21:50:53.049+0000 7f6e477fe640 0 client.4527 ms_handle_reset on v2:172.21.15.53:6802/112708667 2024-09-12T21:50:53.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-12T21:50:53.071+0000 7f6e477fe640 0 client.4414 ms_handle_reset on v2:172.21.15.53:6802/112708667 2024-09-12T21:50:53.072 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:50:53.072 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6", 2024-09-12T21:50:53.072 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-12T21:50:53.072 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4233, 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 13.228518721, 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 5, 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 20, 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 19, 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 16.248391472000002 2024-09-12T21:50:53.073 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:50:53.084 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T21:50:53.095 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T21:50:53.095 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-12T21:50:53.095 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T21:50:53.096 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T21:50:53.096 DEBUG:teuthology.orchestra.run.smithi053:> sync 2024-09-12T21:50:53.201 DEBUG:teuthology.orchestra.run.smithi089:> sync 2024-09-12T21:50:53.409 DEBUG:teuthology.orchestra.run.smithi120:> sync 2024-09-12T21:50:53.616 DEBUG:teuthology.orchestra.run.smithi172:> sync 2024-09-12T21:50:53.770 DEBUG:tasks.thrashosds:checking console status of smithi053 2024-09-12T21:50:53.770 DEBUG:teuthology.orchestra.console.smithi053:Waiting for login prompt 2024-09-12T21:50:53.770 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi053 2024-09-12T21:50:53.911 DEBUG:teuthology.orchestra.console.smithi053:expect before: [Enter `^Ec?' for help] 2024-09-12T21:50:53.911 DEBUG:teuthology.orchestra.console.smithi053:expect after: smithi053 login: 2024-09-12T21:50:53.963 DEBUG:teuthology.orchestra.console.smithi053:console disconnect output: [Enter `^Ec?' for help] smithi053 login: [disconnect] 2024-09-12T21:50:54.063 DEBUG:tasks.thrashosds:checking console status of smithi089 2024-09-12T21:50:54.064 DEBUG:teuthology.orchestra.console.smithi089:Waiting for login prompt 2024-09-12T21:50:54.064 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi089 2024-09-12T21:50:54.162 DEBUG:teuthology.orchestra.console.smithi089:expect before: [Enter `^Ec?' for help] 2024-09-12T21:50:54.162 DEBUG:teuthology.orchestra.console.smithi089:expect after: smithi089 login: 2024-09-12T21:50:54.215 DEBUG:teuthology.orchestra.console.smithi089:console disconnect output: [Enter `^Ec?' for help] smithi089 login: [disconnect] 2024-09-12T21:50:54.315 DEBUG:tasks.thrashosds:checking console status of smithi120 2024-09-12T21:50:54.315 DEBUG:teuthology.orchestra.console.smithi120:Waiting for login prompt 2024-09-12T21:50:54.315 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi120 2024-09-12T21:50:54.486 DEBUG:teuthology.orchestra.console.smithi120:expect before: [Enter `^Ec?' for help] 2024-09-12T21:50:54.486 DEBUG:teuthology.orchestra.console.smithi120:expect after: smithi120 login: 2024-09-12T21:50:54.539 DEBUG:teuthology.orchestra.console.smithi120:console disconnect output: [Enter `^Ec?' for help] smithi120 login: [disconnect] 2024-09-12T21:50:54.641 DEBUG:tasks.thrashosds:checking console status of smithi172 2024-09-12T21:50:54.641 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-09-12T21:50:54.641 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-09-12T21:50:54.773 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] 2024-09-12T21:50:54.773 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-09-12T21:50:54.826 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] smithi172 login: [disconnect] 2024-09-12T21:50:54.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T21:50:55.250 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T21:50:55.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T21:50:55.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:55.546 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:55.555 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T21:50:54.859606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.459810"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:55.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:55.904 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T21:50:54.859606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.459810"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:55.908 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T21:50:55.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 20 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-12T21:50:18.608077+0000 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-12T21:50:43.398142+0000 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:crush_version 4 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:full_ratio 0.95 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:backfillfull_ratio 0.9 2024-09-12T21:50:56.232 INFO:teuthology.orchestra.run.smithi053.stdout:nearfull_ratio 0.85 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:require_min_compat_client luminous 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:min_compat_client jewel 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:require_osd_release squid 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:stretch_mode_enabled false 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:max_osd 3 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/2197885711,v1:172.21.15.89:6801/2197885711] [v2:172.21.15.89:6802/2197885711,v1:172.21.15.89:6803/2197885711] exists,up 4d630dcc-ee37-4038-813b-4830ab592c6c 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/2538027148,v1:172.21.15.120:6801/2538027148] [v2:172.21.15.120:6802/2538027148,v1:172.21.15.120:6803/2538027148] exists,up 671f6920-54e5-4839-ad7e-ca44ff87ceb9 2024-09-12T21:50:56.233 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/1685972058,v1:172.21.15.172:6801/1685972058] [v2:172.21.15.172:6802/1685972058,v1:172.21.15.172:6803/1685972058] exists,up e46b482a-7d0d-48a5-a625-9f8a31045bf3 2024-09-12T21:50:56.246 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/2197885711,v1:172.21.15.89:6801/2197885711] [v2:172.21.15.89:6802/2197885711,v1:172.21.15.89:6803/2197885711] exists,up 4d630dcc-ee37-4038-813b-4830ab592c6c', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/2538027148,v1:172.21.15.120:6801/2538027148] [v2:172.21.15.120:6802/2538027148,v1:172.21.15.120:6803/2538027148] exists,up 671f6920-54e5-4839-ad7e-ca44ff87ceb9', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/1685972058,v1:172.21.15.172:6801/1685972058] [v2:172.21.15.172:6802/1685972058,v1:172.21.15.172:6803/1685972058] exists,up e46b482a-7d0d-48a5-a625-9f8a31045bf3'] 2024-09-12T21:50:56.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T21:50:56.348 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:50:56.348 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mon.a", 2024-09-12T21:50:56.348 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster": "ceph", 2024-09-12T21:50:56.348 INFO:teuthology.orchestra.run.smithi053.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "admin_socket_mode": "", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_client_required": "cephx, none", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_cluster_required": "cephx", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_debug": "true", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_service_required": "cephx", 2024-09-12T21:50:56.349 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_supported": "cephx", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio": "true", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_reap_max": "16", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_async_discard": "false", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_block_size": "4096", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio": "false", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_enable_discard": "false", 2024-09-12T21:50:56.350 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_flock_retry": "3", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_inject_crash": "0", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring": "false", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring_hipri": "false", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T21:50:56.351 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_type": "", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_allocator": "hybrid", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_buffered_io": "true", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T21:50:56.352 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_replay_recovery": "false", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_sync_write": "false", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T21:50:56.353 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_allocator": "hybrid", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_create": "true", 2024-09-12T21:50:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_create": "false", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_path": "", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_size": "0", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_path": "", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_size": "107374182400", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_create": "false", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_path": "", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs": "true", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T21:50:56.355 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_autotune": "true", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size": "0", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T21:50:56.356 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_type": "2q", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_clone_cow": "true", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T21:50:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_mode": "none", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_freelist": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T21:50:56.358 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T21:50:56.359 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fail_eio": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T21:50:56.360 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T21:50:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size": "0", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T21:50:56.362 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T21:50:56.363 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_mem": "512", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T21:50:56.364 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_tracing": "false", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T21:50:56.365 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T21:50:56.366 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_cluster_require_version": "2", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_require_signatures": "false", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_require_version": "2", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_service_require_signatures": "false", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_service_require_version": "2", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_sign_messages": "true", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "chdir": "", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_acl_type": "", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_asio_thread_count": "2", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_cache_mid": "0.750000", 2024-09-12T21:50:56.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_cache_size": "16384", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_caps_release_delay": "5", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_check_pool_perm": "true", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_force_sync_read": "false", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_getattr_caps": "false", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_inject_features": "", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_die_on_failed_remount": "false", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_dirsize_rbytes": "true", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_force_lazyio": "false", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_fs": "", 2024-09-12T21:50:56.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_inject_release_failure": "false", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_max_inline_size": "4096", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mds_namespace": "", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_metadata": "", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_gid": "-1", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_timeout": "300", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_uid": "-1", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mountpoint": "/", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_notify_timeout": "10", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc": "true", 2024-09-12T21:50:56.369 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_objects": "1000", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_size": "209715200", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_permissions": "true", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_quota": "true", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_quota_df": "true", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_max_bytes": "0", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_max_periods": "4", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_min": "131072", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_reconnect_stale": "false", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_shutdown_timeout": "30", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_snapdir": ".snap", 2024-09-12T21:50:56.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_tick_interval": "1", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client_trace": "", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client_use_faked_inos": "false", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client_use_random_mds": "false", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog": "false", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog_port": "12201", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_monitors": "default=true", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog": "false", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog_level": "info", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "-", 2024-09-12T21:50:56.371 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_network": "", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_network_interface": "", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_isal": "false", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_level": "5", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zstd_level": "1", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T21:50:56.372 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location": "", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location_hook": "", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location_hook_timeout": "10", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "daemonize": "false", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "daos_pool": "tank", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_alienstore": "0/5", 2024-09-12T21:50:56.373 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asok": "1/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asok_assert_abort": "false", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_auth": "20/20", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bdev": "1/3", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bluefs": "1/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bluestore": "1/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_buffer": "0/1", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cephsqlite": "0/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_client": "0/5", 2024-09-12T21:50:56.374 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_compressor": "1/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_context": "0/1", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crush": "1/1", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crypto": "1/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cyanstore": "0/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_dpdk": "1/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_eventtrace": "1/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_filer": "0/1", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_filestore": "1/3", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_finisher": "1/1", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_fuse": "1/5", 2024-09-12T21:50:56.375 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_javaclient": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_journal": "1/3", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_journaler": "0/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_kstore": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_lockdep": "0/1", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mclock": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_balancer": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_locker": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_log": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T21:50:56.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_migrator": "1/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_memstore": "1/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mgr": "2/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mgrc": "1/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mon": "20/20", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_monc": "0/10", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_ms": "1/1", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_none": "0/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objclass": "0/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objectcacher": "0/5", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objecter": "0/1", 2024-09-12T21:50:56.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_optracker": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_osd": "1/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_paxos": "20/20", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_perfcounter": "1/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_prioritycache": "1/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rados": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_replay": "0/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_refs": "0/0", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_reserver": "1/1", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw": "1/5", 2024-09-12T21:50:56.378 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_access": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_flight": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_sync": "1/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rocksdb": "4/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_backref": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_cache": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_device": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_epm": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T21:50:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_journal": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_lba": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_odata": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_omap": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_onode": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_t": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_tm": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_striper": "0/1", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_test": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_throttle": "1/1", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_timer": "0/1", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_tp": "0/5", 2024-09-12T21:50:56.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_trace": "1/5", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "device_failure_prediction_mode": "none", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_graylog": "false", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_journald": "false", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_stderr": "true", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_syslog": "false", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event_tracing": "false", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_http_port": "9926", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_prio_limit": "5", 2024-09-12T21:50:56.381 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_sort_metrics": "true", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_stats_period": "5", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "fake_statfs_for_testing": "0", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "fatal_signal_handlers": "true", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filer_max_purge_ops": "10", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filer_max_truncate_ops": "128", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_blackhole": "false", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_btrfs_snap": "true", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_caller_concurrency": "10", 2024-09-12T21:50:56.382 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_omap_check": "false", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_verify_split": "false", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_dump_file": "", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fadvise": "true", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fail_eio": "true", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fd_cache_size": "128", 2024-09-12T21:50:56.383 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fiemap": "false", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_inject_stall": "0", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_parallel": "false", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_trailing": "false", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_writeahead": "false", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_kill_at": "0", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T21:50:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_merge_threshold": "-10", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T21:50:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_odsync_write": "false", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_backend_path": "", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_threads": "2", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_punch_hole": "false", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T21:50:56.386 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_ops": "50", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_seek_data_hole": "false", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_sloppy_crc": "false", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_splice": "false", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_split_multiple": "2", 2024-09-12T21:50:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_split_rand_factor": "20", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_update_to": "1000", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T21:50:56.388 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_xfs_extsize": "false", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_zfs_snap": "false", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fio_dir": "/tmp/fio", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fsid": "26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_allow_other": "true", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_big_writes": "true", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_debug": "false", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_default_permissions": "false", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_disable_pagecache": "false", 2024-09-12T21:50:56.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_max_write": "0", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_multithreaded": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_require_active_mds": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_set_user_groups": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_move": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_read": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_write": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "gss_target_name": "ceph", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_file": "", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_inject_failure": "0", 2024-09-12T21:50:56.390 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_interval": "5", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "host": "smithi053", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T21:50:56.391 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "inject_early_sigterm": "false", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "jaeger_agent_port": "6799", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "jaeger_tracing_enable": "false", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_aio": "true", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_align_min_size": "65536", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_block_align": "true", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_block_size": "4096", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_dio": "true", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_discard": "false", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_force_aio": "false", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_ignore_corruption": "false", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_max_write_entries": "100", 2024-09-12T21:50:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_replay_from": "0", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_write_header_frequency": "0", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_zero_on_create": "false", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_prefetch_periods": "10", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_prezero_periods": "5", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_write_head_interval": "15", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "keyfile": "", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_backend": "rocksdb", 2024-09-12T21:50:56.393 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_max_bytes": "67108864", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_max_ops": "512", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_onode_map_size": "1024", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_sync_transaction": "false", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "librados_thread_count": "2", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "lockdep": "false", 2024-09-12T21:50:56.394 INFO:teuthology.orchestra.run.smithi053.stdout: "lockdep_force_backtrace": "false", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_coarse_timestamps": "true", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_flush_on_exit": "false", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_graylog_port": "12201", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_max_new": "1000", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_max_recent": "10000", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_stderr_prefix": "", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": "true", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_graylog": "false", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_journald": "false", 2024-09-12T21:50:56.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_stderr": "false", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_syslog": "false", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_action_on_write_error": "1", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_alternate_name_max": "8192", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_asio_thread_count": "2", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_export_pin": "true", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_interval": "10", 2024-09-12T21:50:56.396 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_max": "-1", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_max_until": "-1", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_merge_size": "50", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_mode": "0", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_bits": "3", 2024-09-12T21:50:56.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_size": "10000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_mid": "0.700000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T21:50:56.398 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_interval": "1", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T21:50:56.399 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_auth_pins": "false", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_frag": "false", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_scatterstat": "false", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_subtrees": "false", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_default_dir_hash": "2", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_defer_session_stale": "true", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_max_entries": "0", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_prefetch": "true", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T21:50:56.400 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_early_reply": "true", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_enable_op_tracker": "true", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_enforce_unique_name": "true", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T21:50:56.401 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_health_dummy": "false", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T21:50:56.402 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_join_fs": "", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_journal_format": "1", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_create_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_export_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_import_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_link_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_openc_at": "0", 2024-09-12T21:50:56.403 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_rename_at": "0", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_max_events": "-1", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_max_segments": "128", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_pause": "false", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_segment_size": "0", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_threshold": "128", 2024-09-12T21:50:56.404 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_completed_requests": "100000", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_export_size": "20971520", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_file_recover": "32", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_files": "64", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_ops": "8192", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_metrics_update_interval": "2", 2024-09-12T21:50:56.405 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_min_caps_per_client": "100", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_numa_node": "-1", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_duration": "600", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_size": "20", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_log_threshold": "5", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_ping_grace": "15", 2024-09-12T21:50:56.406 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_ping_interval": "5", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_caps": "30000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_replay_interval": "1.000000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_root_ino_gid": "0", 2024-09-12T21:50:56.407 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_root_ino_uid": "0", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_shutdown_check": "0", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_skip_ino": "0", 2024-09-12T21:50:56.408 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_min_uid": "0", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_rstat": "false", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_symlink_recovery": "true", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_thrash_exports": "0", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_thrash_fragments": "0", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_tick_interval": "5.000000", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_valgrind_exit": "false", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_verify_backtrace": "1", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_verify_scatter": "false", 2024-09-12T21:50:56.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_wipe_sessions": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool_debug": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_page_set": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_page_size": "65536", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_bytes": "134217728", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_messages": "512", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T21:50:56.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_disabled_modules": "", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mds_messages": "128", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mon_messages": "128", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_history_duration": "600", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_history_size": "20", 2024-09-12T21:50:56.411 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_op_log_threshold": "5", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_osd_messages": "8192", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_pool": "true", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_standby_modules": "true", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_stats_period": "5", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_stats_threshold": "5", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_tick_period": "2", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T21:50:56.412 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_allow_pool_delete": "true", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_bytes": "104857600", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T21:50:56.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_target_rank": "-1", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T21:50:56.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_start": "false", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_trim": "true", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cpu_threads": "4", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T21:50:56.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_avail_crit": "5", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_avail_warn": "5", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_json": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_extra_checks": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T21:50:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_down_uptime_grace": "60", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_election_default_strategy": "1", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_election_timeout": "5.000000", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_enable_op_tracker": "true", 2024-09-12T21:50:56.417 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_fake_pool_delete": "false", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_force_quorum_join": "false", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_log_update_period": "5", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_max_detail": "50", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog": "true", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_host": "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],[v2:172.21.15.53:3302,v1:172.21.15.53:6791]", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_host_override": "", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_initial_members": "", 2024-09-12T21:50:56.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease": "5.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_full_interval": "50", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_max": "10000", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_max_summary": "50", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_log_epochs": "500", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T21:50:56.419 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_osd": "10000", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_memory_autotune": "true", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_memory_target": "2147483648", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_digest_period": "5", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T21:50:56.420 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_complaint_time": "30", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_duration": "600", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_size": "20", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_log_threshold": "5", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T21:50:56.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_cache_size": "500", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T21:50:56.422 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T21:50:56.423 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_report_timeout": "900", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T21:50:56.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_max_osds": "4", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T21:50:56.425 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_interval": "86400", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_max_keys": "100", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_timeout": "300", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_session_timeout": "300", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_smart_report_timeout": "5", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_pool_size": "4", 2024-09-12T21:50:56.426 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_debug": "false", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_tick_interval": "5", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T21:50:56.427 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_older_version": "true", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T21:50:56.428 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "monmap": "", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T21:50:56.429 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_tracing_enabled": "false", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_op_threads": "3", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_cm": "false", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_device_name": "", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T21:50:56.430 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_sl": "3", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_type": "ib", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_reap_threshold": "5", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_before_connect": "false", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_ipv4": "true", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_ipv6": "false", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_msgr1": "true", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_msgr2": "true", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_port_max": "7568", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_port_min": "6800", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T21:50:56.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_retry_count": "3", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_retry_delay": "5", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_client": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mds": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mgr": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mon": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_osd": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_client_mode": "crc secure", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_cluster_type": "", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_compress_secure": "false", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T21:50:56.432 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_crc_data": "true", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_crc_header": "true", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_bug": "true", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_old_message": "true", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T21:50:56.433 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hugepages": "", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_lro": "true", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_pmd": "", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_port_id": "0", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dump_on_send": "false", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T21:50:56.434 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_type": "", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_network_congestion": "0", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_socket_failures": "0", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_max_accept_failures": "4", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_max_backoff": "15.000000", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compress_mode": "none", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T21:50:56.435 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_pq_min_cost": "65536", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_public_type": "", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_service_mode": "crc secure", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_nodelay": "true", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_type": "async+posix", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "no_config_file": "false", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inflight_ops": "1024", 2024-09-12T21:50:56.436 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_timeout": "10.000000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "objectstore_blackhole": "false", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "openssl_engine_opts": "", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_max_ops": "4", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T21:50:56.437 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_slop": "0.020000", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_asio_thread_count": "2", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_scan_max": "512", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_scan_min": "64", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_peering": "false", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_beacon_report_interval": "300", 2024-09-12T21:50:56.438 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_duration": "30", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_blkin_trace_all": "false", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T21:50:56.439 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_update_on_start": "true", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_message_cap": "256", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_op_priority": "63", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_watch_timeout": "30", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_command_max_records": "256", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_compact_on_start": "false", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T21:50:56.440 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_update_on_start": "true", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T21:50:56.441 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_op_order": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_shutdown": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_trim_objects": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T21:50:56.442 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_default_notify_timeout": "30", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T21:50:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_enable_op_tracker": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_info": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T21:50:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_function_tracing": "false", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_grace": "20", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_interval": "6", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_stale": "600", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T21:50:56.445 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal_size": "5120", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_kill_backfill_at": "0", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_cache_size": "50", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_dedup": "true", 2024-09-12T21:50:56.446 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_message_max": "40", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_attr_name_len": "100", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_attr_size": "0", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_backfills": "1", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_markdown_count": "5", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_markdown_period": "600", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_name_len": "2048", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_size": "134217728", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T21:50:56.447 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pgls": "1024", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_push_cost": "8388608", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_push_objects": "10", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_scrubs": "3", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_write_size": "90", 2024-09-12T21:50:56.448 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_profile": "balanced", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T21:50:56.449 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_base": "805306368", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target": "4294967296", 2024-09-12T21:50:56.450 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target_autotune": "false", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_min_recovery_priority": "0", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_report_interval": "5", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_num_cache_shards": "32", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_node": "-1", 2024-09-12T21:50:56.451 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objecter_finishers": "1", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore": "bluestore", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore_fuse": "false", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore_tracing": "false", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_duration": "600", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_size": "20", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_log_threshold": "5", 2024-09-12T21:50:56.452 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards": "0", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_thread_timeout": "15", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_open_classes_on_start": "true", 2024-09-12T21:50:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_os_flags": "0", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_peering_op_priority": "255", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_delete_priority": "5", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T21:50:56.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_crimson": "false", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T21:50:56.455 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flags": "0", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_min_size": "0", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_size": "2", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_type": "replicated", 2024-09-12T21:50:56.456 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_cost": "20971520", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active": "0", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T21:50:56.457 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_op_priority": "3", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_priority": "5", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_repair_during_recovery": "false", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T21:50:56.458 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_cost": "52428800", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_end_hour": "0", 2024-09-12T21:50:56.459 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_priority": "5", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T21:50:56.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_skip_data_digest": "false", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_smart_report_timeout": "5", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_priority": "5", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T21:50:56.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_target_transaction_size": "30", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T21:50:56.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tracing": "false", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_use_stale_snap": "false", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_kill_at": "0", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_max_join_drift": "10", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_min": "500", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_min_wait": "0.050000", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_max": "500", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_min": "250", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_stash_full_interval": "25", 2024-09-12T21:50:56.463 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_trim_max": "500", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_trim_min": "250", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "perf": "true", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "-", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrv": "", 2024-09-12T21:50:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: "public_bind_addr": "-", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "public_network": "", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "public_network_interface": "", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "qat_compressor_enabled": "false", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_mon_op_timeout": "0", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_osd_op_timeout": "0", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_tracing": "false", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_atime_update_interval": "60", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T21:50:56.465 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache": "true", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_policy": "writearound", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_size": "33554432", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T21:50:56.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_compression_hint": "none", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_clone_format": "auto", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_data_pool": "", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_features": "61", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_format": "2", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_map_options": "", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_order": "22", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_pool": "rbd", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_stripe_count": "0", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T21:50:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_io_scheduler": "simple", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T21:50:56.468 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_order": "24", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_pool": "", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_splay_width": "4", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T21:50:56.469 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T21:50:56.470 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T21:50:56.471 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_op_threads": "1", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_plugins": "", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T21:50:56.472 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T21:50:56.473 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_tracing": "false", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_validate_names": "true", 2024-09-12T21:50:56.474 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_validate_pool": "true", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "restapi_base_url": "", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "restapi_log_level": "", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_admin_entry": "admin", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_backend_store": "rados", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_barbican_url": "", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_beast_enable_async": "true", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T21:50:56.475 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_enabled": "true", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_config_store": "rados", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_content_length_compat": "false", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T21:50:56.476 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cross_domain_policy": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T21:50:56.477 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T21:50:56.478 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T21:50:56.479 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T21:50:56.480 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_port": "6379", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_window": "30", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T21:50:56.481 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T21:50:56.482 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dns_name": "", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dns_s3website_name": "", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T21:50:56.483 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_ops_log": "false", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_static_website": "false", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_usage_log": "false", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_expose_bucket": "false", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_extended_http_attrs": "", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_filter": "none", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T21:50:56.484 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_objs": "32", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T21:50:56.485 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_init_timeout": "300", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_password": "", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T21:50:56.486 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_project": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_token": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_user": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_api_version": "2", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T21:50:56.487 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_url": "", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_objs": "32", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_worker": "3", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T21:50:56.488 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_uri": "", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_http_headers": "", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T21:50:56.489 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attr_size": "0", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_listing_results": "1000", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_notify_retries": "10", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T21:50:56.490 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T21:50:56.491 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T21:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_num_control_oids": "8", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_numa_node": "-1", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_tracing": "false", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_token": "", 2024-09-12T21:50:56.493 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_url": "", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_rados": "false", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T21:50:56.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_print_continue": "true", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_tracing": "false", 2024-09-12T21:50:56.495 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm": "", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm_id": "", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_region": "", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_request_uri": "", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T21:50:56.496 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_resolve_cname": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_run_sync_thread": "true", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T21:50:56.497 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_script_uri": "", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_service_provider_name": "", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_client_id": "", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_client_secret": "", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_entry": "sts", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_key": "sts", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T21:50:56.498 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_auth_url": "", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_custom_header": "", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_need_stats": "true", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_tenant_name": "", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_url": "", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_lease_period": "120", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T21:50:56.499 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_thread_pool_size": "512", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T21:50:56.500 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_comment": "", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_createby": "", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_encoding": "", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_flag": "false", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_origin": "", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_tracker": "", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_max_shards": "32", 2024-09-12T21:50:56.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_use_opa_authz": "false", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_counters_cache": "false", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T21:50:56.502 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_unique_email": "true", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_verify_ssl": "true", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone": "", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone_id": "", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup": "", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup_id": "", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_block_size": "4096", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T21:50:56.503 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T21:50:56.504 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_partition_filters": "false", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_perf": "false", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "run_dir": "/var/run/ceph", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_block_create": "true", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T21:50:56.505 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_device_size": "53687091200", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_full_integrity_check": "false", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_main_device_type": "SSD", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T21:50:56.506 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_segment_size": "67108864", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "set_keepcaps": "false", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "setgroup": "", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "setuser": "", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "setuser_match_path": "", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "thp": "false", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "threadpool_default_timeout": "60", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T21:50:56.507 INFO:teuthology.orchestra.run.smithi053.stdout: "throttler_perf_counter": "true" 2024-09-12T21:50:56.508 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:50:56.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T21:50:56.625 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a: {} 2024-09-12T21:50:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:50:56.634 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b: {} 2024-09-12T21:50:56.634 INFO:teuthology.orchestra.run.smithi053.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:50:56.643 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c: {} 2024-09-12T21:50:56.643 INFO:teuthology.orchestra.run.smithi053.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:50:56.654 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T21:50:56.654 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-12T21:50:56.666 INFO:tasks.radosbench:Beginning radosbench... 2024-09-12T21:50:56.666 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-12T21:50:56.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-12T21:50:56.667 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T21:50:56.667 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T21:50:56.667 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T21:50:56.667 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T21:50:56.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T21:50:56.668 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T21:50:56.668 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T21:50:56.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:50:56.669 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T21:50:56.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:50:56.670 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T21:50:56.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:50:56.671 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:56.668+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:56.770 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:56.768+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:56.785 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:50:56.785 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:50:56.785 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-12T21:50:56.785 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:50:56.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:50:56.806 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:50:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:50:56.825 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:50:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:50:56.843 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:50:56.843 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:50:56.870 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:56.869+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:56.898 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:56.898 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:56.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:50:56.971 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:56.969+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 20, 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: "fsid": "26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6", 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: "created": "2024-09-12T21:50:18.608077+0000", 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: "modified": "2024-09-12T21:50:43.398142+0000", 2024-09-12T21:50:56.984 INFO:teuthology.orchestra.run.smithi053.stdout: "last_up_change": "2024-09-12T21:50:28.694982+0000", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "last_in_change": "2024-09-12T21:50:19.412280+0000", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_num": 5799936, 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_set": [ 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "pglog_hardlimit", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "purged_snapdirs", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_deletes", 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "sortbitwise" 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_version": 4, 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T21:50:56.985 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_snapshot": "", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_max": 4, 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd": 3, 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "require_min_compat_client": "luminous", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "min_compat_client": "jewel", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "require_osd_release": "squid", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_crimson": false, 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "pools": [ 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 1, 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": ".mgr", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:28.897797+0000", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:50:56.986 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 1, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 1, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 1, 2024-09-12T21:50:56.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 1, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 1, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "11", 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:50:56.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:50:56.989 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:50:56.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_max": 32, 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 1 2024-09-12T21:50:56.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": {} 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 2.9900000095367432, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 2.9900000095367432, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 2, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 2, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:50:56.992 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 2, 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "rbd", 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:33.626302+0000", 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 8193, 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:50:56.993 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 8, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 8, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 8, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 8, 2024-09-12T21:50:56.994 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 8, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "15", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:50:56.995 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 2, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 15, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:50:56.996 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:50:56.997 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd": {} 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.5, 2024-09-12T21:50:56.998 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.5, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.5, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.5, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 3, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "cephfs_metadata", 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:37.711817+0000", 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:50:56.999 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-09-12T21:50:57.000 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.001 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "18", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:50:57.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:50:57.004 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_bias": 4, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 16, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_priority": 5 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs": { 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": "cephfs" 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:50:57.005 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.1299999952316284, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.1299999952316284, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 4, 2024-09-12T21:50:57.006 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "cephfs_data", 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:38.173173+0000", 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:50:57.007 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 64, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 64, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 64, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 64, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 64, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.008 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "19", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:50:57.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.010 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 64, 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T21:50:57.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs": { 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "data": "cephfs" 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.1299999952316284, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.1299999952316284, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:50:57.012 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "osds": [ 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "4d630dcc-ee37-4038-813b-4830ab592c6c", 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:50:57.013 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 17, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6800", 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.014 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6801", 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6802", 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6803", 2024-09-12T21:50:57.015 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6806", 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6807", 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6804", 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.017 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6805", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.89:6801/2197885711", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.89:6803/2197885711", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2197885711", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2197885711", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "671f6920-54e5-4839-ad7e-ca44ff87ceb9", 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 17, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:50:57.019 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6800", 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6801", 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6802", 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6803", 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.021 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6806", 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6807", 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.022 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6804", 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.023 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6805", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.120:6801/2538027148", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.120:6803/2538027148", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.120:6807/2538027148", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.120:6805/2538027148", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "e46b482a-7d0d-48a5-a625-9f8a31045bf3", 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 17, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:50:57.025 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6800", 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6801", 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.026 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6802", 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6803", 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.027 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6806", 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6807", 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6804", 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6805", 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.029 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.172:6801/1685972058", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.172:6803/1685972058", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.172:6807/1685972058", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.172:6805/1685972058", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_xinfo": [ 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:50:57.030 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.056106+0000", 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.592376+0000", 2024-09-12T21:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.835978+0000", 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:50:57.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap": [], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_items": [], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_primaries": [], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_temp": [], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_temp": [], 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklist": {}, 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "range_blocklist": {}, 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profiles": { 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "default": { 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-failure-domain": "osd", 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "k": "2", 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "m": "1", 2024-09-12T21:50:57.033 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin": "jerasure", 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "technique": "reed_sol_van" 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps_queue": [], 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "new_removed_snaps": [], 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "new_purged_snaps": [ 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 2, 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "snaps": [ 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "begin": 2, 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: "length": 1 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:50:57.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_node_flags": {}, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "device_class_flags": {}, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode": { 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_enabled": false, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_bucket_count": 0, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "degraded_stretch_mode": 0, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "recovering_stretch_mode": 0, 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_bucket": 0 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:50:57.035 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:50:57.036 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.037 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.037 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': '26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6', 'created': '2024-09-12T21:50:18.608077+0000', 'modified': '2024-09-12T21:50:43.398142+0000', 'last_up_change': '2024-09-12T21:50:28.694982+0000', 'last_in_change': '2024-09-12T21:50:19.412280+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T21:50:28.897797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T21:50:33.626302+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T21:50:37.711817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T21:50:38.173173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4d630dcc-ee37-4038-813b-4830ab592c6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2197885711}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2197885711}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2197885711}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2197885711}]}, 'public_addr': '172.21.15.89:6801/2197885711', 'cluster_addr': '172.21.15.89:6803/2197885711', 'heartbeat_back_addr': '172.21.15.89:6807/2197885711', 'heartbeat_front_addr': '172.21.15.89:6805/2197885711', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '671f6920-54e5-4839-ad7e-ca44ff87ceb9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 2538027148}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 2538027148}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 2538027148}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 2538027148}]}, 'public_addr': '172.21.15.120:6801/2538027148', 'cluster_addr': '172.21.15.120:6803/2538027148', 'heartbeat_back_addr': '172.21.15.120:6807/2538027148', 'heartbeat_front_addr': '172.21.15.120:6805/2538027148', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e46b482a-7d0d-48a5-a625-9f8a31045bf3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6800', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6801', 'nonce': 1685972058}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6802', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6803', 'nonce': 1685972058}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6806', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6807', 'nonce': 1685972058}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6804', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6805', 'nonce': 1685972058}]}, 'public_addr': '172.21.15.172:6801/1685972058', 'cluster_addr': '172.21.15.172:6803/1685972058', 'heartbeat_back_addr': '172.21.15.172:6807/1685972058', 'heartbeat_front_addr': '172.21.15.172:6805/1685972058', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.056106+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.592376+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.835978+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T21:50:57.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:50:57.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:50:57.082 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:57.080+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:57.154 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.154 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:50:57.204 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:57.202+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:57.239 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'unique_pool_0' created 2024-09-12T21:50:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:50:57.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-12T21:50:57.274 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:57.272+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:57.308 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.308 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:50:57.339 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:50:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:50:57.350 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T21:50:57.239745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86980,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028540,"statfs":{"total":289910292480,"available":289821224960,"internally_reserved":0,"allocated":1777664,"data_stored":1375416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.381792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402573+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:50:43.402573+0000","last_peered":"2024-09-12T21:50:43.402573+0000","last_clean":"2024-09-12T21:50:43.402573+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:50:43.402573+0000","last_undegraded":"2024-09-12T21:50:43.402573+0000","last_fullsized":"2024-09-12T21:50:43.402573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402140+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:50:43.402140+0000","last_peered":"2024-09-12T21:50:43.402140+0000","last_clean":"2024-09-12T21:50:43.402140+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:50:43.402140+0000","last_undegraded":"2024-09-12T21:50:43.402140+0000","last_fullsized":"2024-09-12T21:50:43.402140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402048+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:50:43.402048+0000","last_peered":"2024-09-12T21:50:43.402048+0000","last_clean":"2024-09-12T21:50:43.402048+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:50:43.402048+0000","last_undegraded":"2024-09-12T21:50:43.402048+0000","last_fullsized":"2024-09-12T21:50:43.402048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402447+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:50:43.402447+0000","last_peered":"2024-09-12T21:50:43.402447+0000","last_clean":"2024-09-12T21:50:43.402447+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:50:43.402447+0000","last_undegraded":"2024-09-12T21:50:43.402447+0000","last_fullsized":"2024-09-12T21:50:43.402447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401535+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:50:43.401535+0000","last_peered":"2024-09-12T21:50:43.401535+0000","last_clean":"2024-09-12T21:50:43.401535+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:50:43.401535+0000","last_undegraded":"2024-09-12T21:50:43.401535+0000","last_fullsized":"2024-09-12T21:50:43.401535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401509+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:50:43.401509+0000","last_peered":"2024-09-12T21:50:43.401509+0000","last_clean":"2024-09-12T21:50:43.401509+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:50:43.401509+0000","last_undegraded":"2024-09-12T21:50:43.401509+0000","last_fullsized":"2024-09-12T21:50:43.401509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401257+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:50:43.401257+0000","last_peered":"2024-09-12T21:50:43.401257+0000","last_clean":"2024-09-12T21:50:43.401257+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:50:43.401257+0000","last_undegraded":"2024-09-12T21:50:43.401257+0000","last_fullsized":"2024-09-12T21:50:43.401257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402202+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:50:43.402202+0000","last_peered":"2024-09-12T21:50:43.402202+0000","last_clean":"2024-09-12T21:50:43.402202+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:50:43.402202+0000","last_undegraded":"2024-09-12T21:50:43.402202+0000","last_fullsized":"2024-09-12T21:50:43.402202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402197+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:50:43.402197+0000","last_peered":"2024-09-12T21:50:43.402197+0000","last_clean":"2024-09-12T21:50:43.402197+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:50:43.402197+0000","last_undegraded":"2024-09-12T21:50:43.402197+0000","last_fullsized":"2024-09-12T21:50:43.402197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402182+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:50:43.402182+0000","last_peered":"2024-09-12T21:50:43.402182+0000","last_clean":"2024-09-12T21:50:43.402182+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:50:43.402182+0000","last_undegraded":"2024-09-12T21:50:43.402182+0000","last_fullsized":"2024-09-12T21:50:43.402182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402265+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:50:43.402265+0000","last_peered":"2024-09-12T21:50:43.402265+0000","last_clean":"2024-09-12T21:50:43.402265+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:50:43.402265+0000","last_undegraded":"2024-09-12T21:50:43.402265+0000","last_fullsized":"2024-09-12T21:50:43.402265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401878+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:50:43.401878+0000","last_peered":"2024-09-12T21:50:43.401878+0000","last_clean":"2024-09-12T21:50:43.401878+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:50:43.401878+0000","last_undegraded":"2024-09-12T21:50:43.401878+0000","last_fullsized":"2024-09-12T21:50:43.401878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401568+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:50:43.401568+0000","last_peered":"2024-09-12T21:50:43.401568+0000","last_clean":"2024-09-12T21:50:43.401568+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:50:43.401568+0000","last_undegraded":"2024-09-12T21:50:43.401568+0000","last_fullsized":"2024-09-12T21:50:43.401568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401585+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:50:43.401585+0000","last_peered":"2024-09-12T21:50:43.401585+0000","last_clean":"2024-09-12T21:50:43.401585+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:50:43.401585+0000","last_undegraded":"2024-09-12T21:50:43.401585+0000","last_fullsized":"2024-09-12T21:50:43.401585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401318+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:50:43.401318+0000","last_peered":"2024-09-12T21:50:43.401318+0000","last_clean":"2024-09-12T21:50:43.401318+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:50:43.401318+0000","last_undegraded":"2024-09-12T21:50:43.401318+0000","last_fullsized":"2024-09-12T21:50:43.401318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402626+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:50:43.402626+0000","last_peered":"2024-09-12T21:50:43.402626+0000","last_clean":"2024-09-12T21:50:43.402626+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:50:43.402626+0000","last_undegraded":"2024-09-12T21:50:43.402626+0000","last_fullsized":"2024-09-12T21:50:43.402626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402316+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:50:43.402316+0000","last_peered":"2024-09-12T21:50:43.402316+0000","last_clean":"2024-09-12T21:50:43.402316+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:50:43.402316+0000","last_undegraded":"2024-09-12T21:50:43.402316+0000","last_fullsized":"2024-09-12T21:50:43.402316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401741+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:50:43.401741+0000","last_peered":"2024-09-12T21:50:43.401741+0000","last_clean":"2024-09-12T21:50:43.401741+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:50:43.401741+0000","last_undegraded":"2024-09-12T21:50:43.401741+0000","last_fullsized":"2024-09-12T21:50:43.401741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401839+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:50:43.401839+0000","last_peered":"2024-09-12T21:50:43.401839+0000","last_clean":"2024-09-12T21:50:43.401839+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:50:43.401839+0000","last_undegraded":"2024-09-12T21:50:43.401839+0000","last_fullsized":"2024-09-12T21:50:43.401839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401197+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:50:43.401197+0000","last_peered":"2024-09-12T21:50:43.401197+0000","last_clean":"2024-09-12T21:50:43.401197+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:50:43.401197+0000","last_undegraded":"2024-09-12T21:50:43.401197+0000","last_fullsized":"2024-09-12T21:50:43.401197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401474+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:50:43.401474+0000","last_peered":"2024-09-12T21:50:43.401474+0000","last_clean":"2024-09-12T21:50:43.401474+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:50:43.401474+0000","last_undegraded":"2024-09-12T21:50:43.401474+0000","last_fullsized":"2024-09-12T21:50:43.401474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402761+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:50:43.402761+0000","last_peered":"2024-09-12T21:50:43.402761+0000","last_clean":"2024-09-12T21:50:43.402761+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:50:43.402761+0000","last_undegraded":"2024-09-12T21:50:43.402761+0000","last_fullsized":"2024-09-12T21:50:43.402761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402479+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:50:43.402479+0000","last_peered":"2024-09-12T21:50:43.402479+0000","last_clean":"2024-09-12T21:50:43.402479+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:50:43.402479+0000","last_undegraded":"2024-09-12T21:50:43.402479+0000","last_fullsized":"2024-09-12T21:50:43.402479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402189+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:50:43.402189+0000","last_peered":"2024-09-12T21:50:43.402189+0000","last_clean":"2024-09-12T21:50:43.402189+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:50:43.402189+0000","last_undegraded":"2024-09-12T21:50:43.402189+0000","last_fullsized":"2024-09-12T21:50:43.402189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402627+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:50:43.402627+0000","last_peered":"2024-09-12T21:50:43.402627+0000","last_clean":"2024-09-12T21:50:43.402627+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:50:43.402627+0000","last_undegraded":"2024-09-12T21:50:43.402627+0000","last_fullsized":"2024-09-12T21:50:43.402627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401967+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:50:43.401967+0000","last_peered":"2024-09-12T21:50:43.401967+0000","last_clean":"2024-09-12T21:50:43.401967+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:50:43.401967+0000","last_undegraded":"2024-09-12T21:50:43.401967+0000","last_fullsized":"2024-09-12T21:50:43.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401244+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:50:43.401244+0000","last_peered":"2024-09-12T21:50:43.401244+0000","last_clean":"2024-09-12T21:50:43.401244+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:50:43.401244+0000","last_undegraded":"2024-09-12T21:50:43.401244+0000","last_fullsized":"2024-09-12T21:50:43.401244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401354+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:50:43.401354+0000","last_peered":"2024-09-12T21:50:43.401354+0000","last_clean":"2024-09-12T21:50:43.401354+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:50:43.401354+0000","last_undegraded":"2024-09-12T21:50:43.401354+0000","last_fullsized":"2024-09-12T21:50:43.401354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402440+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:50:43.402440+0000","last_peered":"2024-09-12T21:50:43.402440+0000","last_clean":"2024-09-12T21:50:43.402440+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:50:43.402440+0000","last_undegraded":"2024-09-12T21:50:43.402440+0000","last_fullsized":"2024-09-12T21:50:43.402440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401984+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:50:43.401984+0000","last_peered":"2024-09-12T21:50:43.401984+0000","last_clean":"2024-09-12T21:50:43.401984+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:50:43.401984+0000","last_undegraded":"2024-09-12T21:50:43.401984+0000","last_fullsized":"2024-09-12T21:50:43.401984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402538+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:50:43.402538+0000","last_peered":"2024-09-12T21:50:43.402538+0000","last_clean":"2024-09-12T21:50:43.402538+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:50:43.402538+0000","last_undegraded":"2024-09-12T21:50:43.402538+0000","last_fullsized":"2024-09-12T21:50:43.402538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401552+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:50:43.401552+0000","last_peered":"2024-09-12T21:50:43.401552+0000","last_clean":"2024-09-12T21:50:43.401552+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:50:43.401552+0000","last_undegraded":"2024-09-12T21:50:43.401552+0000","last_fullsized":"2024-09-12T21:50:43.401552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402705+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:50:43.402705+0000","last_peered":"2024-09-12T21:50:43.402705+0000","last_clean":"2024-09-12T21:50:43.402705+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:50:43.402705+0000","last_undegraded":"2024-09-12T21:50:43.402705+0000","last_fullsized":"2024-09-12T21:50:43.402705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401687+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:50:43.401687+0000","last_peered":"2024-09-12T21:50:43.401687+0000","last_clean":"2024-09-12T21:50:43.401687+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:50:43.401687+0000","last_undegraded":"2024-09-12T21:50:43.401687+0000","last_fullsized":"2024-09-12T21:50:43.401687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402269+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:50:43.402269+0000","last_peered":"2024-09-12T21:50:43.402269+0000","last_clean":"2024-09-12T21:50:43.402269+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:50:43.402269+0000","last_undegraded":"2024-09-12T21:50:43.402269+0000","last_fullsized":"2024-09-12T21:50:43.402269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401428+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:50:43.401428+0000","last_peered":"2024-09-12T21:50:43.401428+0000","last_clean":"2024-09-12T21:50:43.401428+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:50:43.401428+0000","last_undegraded":"2024-09-12T21:50:43.401428+0000","last_fullsized":"2024-09-12T21:50:43.401428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402464+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:50:43.402464+0000","last_peered":"2024-09-12T21:50:43.402464+0000","last_clean":"2024-09-12T21:50:43.402464+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:50:43.402464+0000","last_undegraded":"2024-09-12T21:50:43.402464+0000","last_fullsized":"2024-09-12T21:50:43.402464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401522+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:50:43.401522+0000","last_peered":"2024-09-12T21:50:43.401522+0000","last_clean":"2024-09-12T21:50:43.401522+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:50:43.401522+0000","last_undegraded":"2024-09-12T21:50:43.401522+0000","last_fullsized":"2024-09-12T21:50:43.401522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402492+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:50:43.402492+0000","last_peered":"2024-09-12T21:50:43.402492+0000","last_clean":"2024-09-12T21:50:43.402492+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:50:43.402492+0000","last_undegraded":"2024-09-12T21:50:43.402492+0000","last_fullsized":"2024-09-12T21:50:43.402492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401565+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:50:43.401565+0000","last_peered":"2024-09-12T21:50:43.401565+0000","last_clean":"2024-09-12T21:50:43.401565+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:50:43.401565+0000","last_undegraded":"2024-09-12T21:50:43.401565+0000","last_fullsized":"2024-09-12T21:50:43.401565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402606+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:50:43.402606+0000","last_peered":"2024-09-12T21:50:43.402606+0000","last_clean":"2024-09-12T21:50:43.402606+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:50:43.402606+0000","last_undegraded":"2024-09-12T21:50:43.402606+0000","last_fullsized":"2024-09-12T21:50:43.402606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401892+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:50:43.401892+0000","last_peered":"2024-09-12T21:50:43.401892+0000","last_clean":"2024-09-12T21:50:43.401892+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:50:43.401892+0000","last_undegraded":"2024-09-12T21:50:43.401892+0000","last_fullsized":"2024-09-12T21:50:43.401892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402747+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:50:43.402747+0000","last_peered":"2024-09-12T21:50:43.402747+0000","last_clean":"2024-09-12T21:50:43.402747+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:50:43.402747+0000","last_undegraded":"2024-09-12T21:50:43.402747+0000","last_fullsized":"2024-09-12T21:50:43.402747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401883+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:50:43.401883+0000","last_peered":"2024-09-12T21:50:43.401883+0000","last_clean":"2024-09-12T21:50:43.401883+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:50:43.401883+0000","last_undegraded":"2024-09-12T21:50:43.401883+0000","last_fullsized":"2024-09-12T21:50:43.401883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402008+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:50:43.402008+0000","last_peered":"2024-09-12T21:50:43.402008+0000","last_clean":"2024-09-12T21:50:43.402008+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:50:43.402008+0000","last_undegraded":"2024-09-12T21:50:43.402008+0000","last_fullsized":"2024-09-12T21:50:43.402008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402364+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:50:43.402364+0000","last_peered":"2024-09-12T21:50:43.402364+0000","last_clean":"2024-09-12T21:50:43.402364+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:50:43.402364+0000","last_undegraded":"2024-09-12T21:50:43.402364+0000","last_fullsized":"2024-09-12T21:50:43.402364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401943+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:50:43.401943+0000","last_peered":"2024-09-12T21:50:43.401943+0000","last_clean":"2024-09-12T21:50:43.401943+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:50:43.401943+0000","last_undegraded":"2024-09-12T21:50:43.401943+0000","last_fullsized":"2024-09-12T21:50:43.401943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402315+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:50:43.402315+0000","last_peered":"2024-09-12T21:50:43.402315+0000","last_clean":"2024-09-12T21:50:43.402315+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:50:43.402315+0000","last_undegraded":"2024-09-12T21:50:43.402315+0000","last_fullsized":"2024-09-12T21:50:43.402315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401744+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:50:43.401744+0000","last_peered":"2024-09-12T21:50:43.401744+0000","last_clean":"2024-09-12T21:50:43.401744+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:50:43.401744+0000","last_undegraded":"2024-09-12T21:50:43.401744+0000","last_fullsized":"2024-09-12T21:50:43.401744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402375+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:50:43.402375+0000","last_peered":"2024-09-12T21:50:43.402375+0000","last_clean":"2024-09-12T21:50:43.402375+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:50:43.402375+0000","last_undegraded":"2024-09-12T21:50:43.402375+0000","last_fullsized":"2024-09-12T21:50:43.402375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401612+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:50:43.401612+0000","last_peered":"2024-09-12T21:50:43.401612+0000","last_clean":"2024-09-12T21:50:43.401612+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:50:43.401612+0000","last_undegraded":"2024-09-12T21:50:43.401612+0000","last_fullsized":"2024-09-12T21:50:43.401612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402338+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:50:43.402338+0000","last_peered":"2024-09-12T21:50:43.402338+0000","last_clean":"2024-09-12T21:50:43.402338+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:50:43.402338+0000","last_undegraded":"2024-09-12T21:50:43.402338+0000","last_fullsized":"2024-09-12T21:50:43.402338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401841+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:50:43.401841+0000","last_peered":"2024-09-12T21:50:43.401841+0000","last_clean":"2024-09-12T21:50:43.401841+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:50:43.401841+0000","last_undegraded":"2024-09-12T21:50:43.401841+0000","last_fullsized":"2024-09-12T21:50:43.401841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402354+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:50:43.402354+0000","last_peered":"2024-09-12T21:50:43.402354+0000","last_clean":"2024-09-12T21:50:43.402354+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:50:43.402354+0000","last_undegraded":"2024-09-12T21:50:43.402354+0000","last_fullsized":"2024-09-12T21:50:43.402354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401670+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:50:43.401670+0000","last_peered":"2024-09-12T21:50:43.401670+0000","last_clean":"2024-09-12T21:50:43.401670+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:50:43.401670+0000","last_undegraded":"2024-09-12T21:50:43.401670+0000","last_fullsized":"2024-09-12T21:50:43.401670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402468+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:50:43.402468+0000","last_peered":"2024-09-12T21:50:43.402468+0000","last_clean":"2024-09-12T21:50:43.402468+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:50:43.402468+0000","last_undegraded":"2024-09-12T21:50:43.402468+0000","last_fullsized":"2024-09-12T21:50:43.402468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401603+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:50:43.401603+0000","last_peered":"2024-09-12T21:50:43.401603+0000","last_clean":"2024-09-12T21:50:43.401603+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:50:43.401603+0000","last_undegraded":"2024-09-12T21:50:43.401603+0000","last_fullsized":"2024-09-12T21:50:43.401603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401501+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:50:43.401501+0000","last_peered":"2024-09-12T21:50:43.401501+0000","last_clean":"2024-09-12T21:50:43.401501+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:50:43.401501+0000","last_undegraded":"2024-09-12T21:50:43.401501+0000","last_fullsized":"2024-09-12T21:50:43.401501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402323+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:50:43.402323+0000","last_peered":"2024-09-12T21:50:43.402323+0000","last_clean":"2024-09-12T21:50:43.402323+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:50:43.402323+0000","last_undegraded":"2024-09-12T21:50:43.402323+0000","last_fullsized":"2024-09-12T21:50:43.402323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401689+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:50:43.401689+0000","last_peered":"2024-09-12T21:50:43.401689+0000","last_clean":"2024-09-12T21:50:43.401689+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:50:43.401689+0000","last_undegraded":"2024-09-12T21:50:43.401689+0000","last_fullsized":"2024-09-12T21:50:43.401689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401672+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:50:43.401672+0000","last_peered":"2024-09-12T21:50:43.401672+0000","last_clean":"2024-09-12T21:50:43.401672+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:50:43.401672+0000","last_undegraded":"2024-09-12T21:50:43.401672+0000","last_fullsized":"2024-09-12T21:50:43.401672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402430+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:50:43.402430+0000","last_peered":"2024-09-12T21:50:43.402430+0000","last_clean":"2024-09-12T21:50:43.402430+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:50:43.402430+0000","last_undegraded":"2024-09-12T21:50:43.402430+0000","last_fullsized":"2024-09-12T21:50:43.402430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402081+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:50:43.402081+0000","last_peered":"2024-09-12T21:50:43.402081+0000","last_clean":"2024-09-12T21:50:43.402081+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:50:43.402081+0000","last_undegraded":"2024-09-12T21:50:43.402081+0000","last_fullsized":"2024-09-12T21:50:43.402081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402124+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:50:43.402124+0000","last_peered":"2024-09-12T21:50:43.402124+0000","last_clean":"2024-09-12T21:50:43.402124+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:50:43.402124+0000","last_undegraded":"2024-09-12T21:50:43.402124+0000","last_fullsized":"2024-09-12T21:50:43.402124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401994+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:50:43.401994+0000","last_peered":"2024-09-12T21:50:43.401994+0000","last_clean":"2024-09-12T21:50:43.401994+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:50:43.401994+0000","last_undegraded":"2024-09-12T21:50:43.401994+0000","last_fullsized":"2024-09-12T21:50:43.401994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402640+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:50:43.402640+0000","last_peered":"2024-09-12T21:50:43.402640+0000","last_clean":"2024-09-12T21:50:43.402640+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:50:43.402640+0000","last_undegraded":"2024-09-12T21:50:43.402640+0000","last_fullsized":"2024-09-12T21:50:43.402640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402168+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:50:43.402168+0000","last_peered":"2024-09-12T21:50:43.402168+0000","last_clean":"2024-09-12T21:50:43.402168+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:50:43.402168+0000","last_undegraded":"2024-09-12T21:50:43.402168+0000","last_fullsized":"2024-09-12T21:50:43.402168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401872+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:50:43.401872+0000","last_peered":"2024-09-12T21:50:43.401872+0000","last_clean":"2024-09-12T21:50:43.401872+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:50:43.401872+0000","last_undegraded":"2024-09-12T21:50:43.401872+0000","last_fullsized":"2024-09-12T21:50:43.401872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402054+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:50:43.402054+0000","last_peered":"2024-09-12T21:50:43.402054+0000","last_clean":"2024-09-12T21:50:43.402054+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:50:43.402054+0000","last_undegraded":"2024-09-12T21:50:43.402054+0000","last_fullsized":"2024-09-12T21:50:43.402054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402981+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:50:43.402981+0000","last_peered":"2024-09-12T21:50:43.402981+0000","last_clean":"2024-09-12T21:50:43.402981+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:50:43.402981+0000","last_undegraded":"2024-09-12T21:50:43.402981+0000","last_fullsized":"2024-09-12T21:50:43.402981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402010+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:50:43.402010+0000","last_peered":"2024-09-12T21:50:43.402010+0000","last_clean":"2024-09-12T21:50:43.402010+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:50:43.402010+0000","last_undegraded":"2024-09-12T21:50:43.402010+0000","last_fullsized":"2024-09-12T21:50:43.402010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402667+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:50:43.402667+0000","last_peered":"2024-09-12T21:50:43.402667+0000","last_clean":"2024-09-12T21:50:43.402667+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:50:43.402667+0000","last_undegraded":"2024-09-12T21:50:43.402667+0000","last_fullsized":"2024-09-12T21:50:43.402667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402844+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:50:43.402844+0000","last_peered":"2024-09-12T21:50:43.402844+0000","last_clean":"2024-09-12T21:50:43.402844+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:50:43.402844+0000","last_undegraded":"2024-09-12T21:50:43.402844+0000","last_fullsized":"2024-09-12T21:50:43.402844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401408+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:50:43.401408+0000","last_peered":"2024-09-12T21:50:43.401408+0000","last_clean":"2024-09-12T21:50:43.401408+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:50:43.401408+0000","last_undegraded":"2024-09-12T21:50:43.401408+0000","last_fullsized":"2024-09-12T21:50:43.401408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T21:50:57.235150+0000","last_change":"2024-09-12T21:50:57.235150+0000","last_active":"2024-09-12T21:50:57.235150+0000","last_peered":"2024-09-12T21:50:57.235150+0000","last_clean":"2024-09-12T21:50:57.235150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T21:50:57.235150+0000","last_undegraded":"2024-09-12T21:50:57.235150+0000","last_fullsized":"2024-09-12T21:50:57.235150+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402769+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:50:43.402769+0000","last_peered":"2024-09-12T21:50:43.402769+0000","last_clean":"2024-09-12T21:50:43.402769+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:50:43.402769+0000","last_undegraded":"2024-09-12T21:50:43.402769+0000","last_fullsized":"2024-09-12T21:50:43.402769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402581+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:50:43.402581+0000","last_peered":"2024-09-12T21:50:43.402581+0000","last_clean":"2024-09-12T21:50:43.402581+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:50:43.402581+0000","last_undegraded":"2024-09-12T21:50:43.402581+0000","last_fullsized":"2024-09-12T21:50:43.402581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401604+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:50:43.401604+0000","last_peered":"2024-09-12T21:50:43.401604+0000","last_clean":"2024-09-12T21:50:43.401604+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:50:43.401604+0000","last_undegraded":"2024-09-12T21:50:43.401604+0000","last_fullsized":"2024-09-12T21:50:43.401604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402663+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:50:43.402663+0000","last_peered":"2024-09-12T21:50:43.402663+0000","last_clean":"2024-09-12T21:50:43.402663+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:50:43.402663+0000","last_undegraded":"2024-09-12T21:50:43.402663+0000","last_fullsized":"2024-09-12T21:50:43.402663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401400+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:50:43.401400+0000","last_peered":"2024-09-12T21:50:43.401400+0000","last_clean":"2024-09-12T21:50:43.401400+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:50:43.401400+0000","last_undegraded":"2024-09-12T21:50:43.401400+0000","last_fullsized":"2024-09-12T21:50:43.401400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402857+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:50:43.402857+0000","last_peered":"2024-09-12T21:50:43.402857+0000","last_clean":"2024-09-12T21:50:43.402857+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:50:43.402857+0000","last_undegraded":"2024-09-12T21:50:43.402857+0000","last_fullsized":"2024-09-12T21:50:43.402857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402476+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:50:43.402476+0000","last_peered":"2024-09-12T21:50:43.402476+0000","last_clean":"2024-09-12T21:50:43.402476+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:50:43.402476+0000","last_undegraded":"2024-09-12T21:50:43.402476+0000","last_fullsized":"2024-09-12T21:50:43.402476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401311+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:50:43.401311+0000","last_peered":"2024-09-12T21:50:43.401311+0000","last_clean":"2024-09-12T21:50:43.401311+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:50:43.401311+0000","last_undegraded":"2024-09-12T21:50:43.401311+0000","last_fullsized":"2024-09-12T21:50:43.401311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401412+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:50:43.401412+0000","last_peered":"2024-09-12T21:50:43.401412+0000","last_clean":"2024-09-12T21:50:43.401412+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:50:43.401412+0000","last_undegraded":"2024-09-12T21:50:43.401412+0000","last_fullsized":"2024-09-12T21:50:43.401412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402751+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:50:43.402751+0000","last_peered":"2024-09-12T21:50:43.402751+0000","last_clean":"2024-09-12T21:50:43.402751+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:50:43.402751+0000","last_undegraded":"2024-09-12T21:50:43.402751+0000","last_fullsized":"2024-09-12T21:50:43.402751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401574+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:50:43.401574+0000","last_peered":"2024-09-12T21:50:43.401574+0000","last_clean":"2024-09-12T21:50:43.401574+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:50:43.401574+0000","last_undegraded":"2024-09-12T21:50:43.401574+0000","last_fullsized":"2024-09-12T21:50:43.401574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402488+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:50:43.402488+0000","last_peered":"2024-09-12T21:50:43.402488+0000","last_clean":"2024-09-12T21:50:43.402488+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:50:43.402488+0000","last_undegraded":"2024-09-12T21:50:43.402488+0000","last_fullsized":"2024-09-12T21:50:43.402488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401450+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:50:43.401450+0000","last_peered":"2024-09-12T21:50:43.401450+0000","last_clean":"2024-09-12T21:50:43.401450+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:50:43.401450+0000","last_undegraded":"2024-09-12T21:50:43.401450+0000","last_fullsized":"2024-09-12T21:50:43.401450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402451+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:50:43.402451+0000","last_peered":"2024-09-12T21:50:43.402451+0000","last_clean":"2024-09-12T21:50:43.402451+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:50:43.402451+0000","last_undegraded":"2024-09-12T21:50:43.402451+0000","last_fullsized":"2024-09-12T21:50:43.402451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402035+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:50:43.402035+0000","last_peered":"2024-09-12T21:50:43.402035+0000","last_clean":"2024-09-12T21:50:43.402035+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:50:43.402035+0000","last_undegraded":"2024-09-12T21:50:43.402035+0000","last_fullsized":"2024-09-12T21:50:43.402035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402437+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:50:43.402437+0000","last_peered":"2024-09-12T21:50:43.402437+0000","last_clean":"2024-09-12T21:50:43.402437+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:50:43.402437+0000","last_undegraded":"2024-09-12T21:50:43.402437+0000","last_fullsized":"2024-09-12T21:50:43.402437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402619+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:50:43.402619+0000","last_peered":"2024-09-12T21:50:43.402619+0000","last_clean":"2024-09-12T21:50:43.402619+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:50:43.402619+0000","last_undegraded":"2024-09-12T21:50:43.402619+0000","last_fullsized":"2024-09-12T21:50:43.402619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401863+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:50:43.401863+0000","last_peered":"2024-09-12T21:50:43.401863+0000","last_clean":"2024-09-12T21:50:43.401863+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:50:43.401863+0000","last_undegraded":"2024-09-12T21:50:43.401863+0000","last_fullsized":"2024-09-12T21:50:43.401863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402560+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:50:43.402560+0000","last_peered":"2024-09-12T21:50:43.402560+0000","last_clean":"2024-09-12T21:50:43.402560+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:50:43.402560+0000","last_undegraded":"2024-09-12T21:50:43.402560+0000","last_fullsized":"2024-09-12T21:50:43.402560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401757+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:50:43.401757+0000","last_peered":"2024-09-12T21:50:43.401757+0000","last_clean":"2024-09-12T21:50:43.401757+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:50:43.401757+0000","last_undegraded":"2024-09-12T21:50:43.401757+0000","last_fullsized":"2024-09-12T21:50:43.401757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402651+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:50:43.402651+0000","last_peered":"2024-09-12T21:50:43.402651+0000","last_clean":"2024-09-12T21:50:43.402651+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:50:43.402651+0000","last_undegraded":"2024-09-12T21:50:43.402651+0000","last_fullsized":"2024-09-12T21:50:43.402651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401804+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:50:43.401804+0000","last_peered":"2024-09-12T21:50:43.401804+0000","last_clean":"2024-09-12T21:50:43.401804+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:50:43.401804+0000","last_undegraded":"2024-09-12T21:50:43.401804+0000","last_fullsized":"2024-09-12T21:50:43.401804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402633+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:50:43.402633+0000","last_peered":"2024-09-12T21:50:43.402633+0000","last_clean":"2024-09-12T21:50:43.402633+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:50:43.402633+0000","last_undegraded":"2024-09-12T21:50:43.402633+0000","last_fullsized":"2024-09-12T21:50:43.402633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.401491+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:50:43.401491+0000","last_peered":"2024-09-12T21:50:43.401491+0000","last_clean":"2024-09-12T21:50:43.401491+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:50:43.401491+0000","last_undegraded":"2024-09-12T21:50:43.401491+0000","last_fullsized":"2024-09-12T21:50:43.401491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T21:50:43.402521+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:50:43.402521+0000","last_peered":"2024-09-12T21:50:43.402521+0000","last_clean":"2024-09-12T21:50:43.402521+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:50:43.402521+0000","last_undegraded":"2024-09-12T21:50:43.402521+0000","last_fullsized":"2024-09-12T21:50:43.402521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":656071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:50:57.356 INFO:tasks.thrashosds.thrasher:Setting 3.12 to [0, 1, 2] 2024-09-12T21:50:57.356 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.12', '0', '1', '2'] 2024-09-12T21:50:57.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.12 0 1 2 2024-09-12T21:50:57.375 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:57.373+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:57.419 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.419 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:50:57.476 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:57.474+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:57.543 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.544 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:50:57.595 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:57.593+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:57.677 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:57.675+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T21:50:57.698 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.698 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:50:57.701 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T21:50:57.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:50:57.778 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:57.776+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:57.852 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.852 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:50:57.904 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:57.903+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:57.973 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:57.973 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:57.979 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:57.978+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:57.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:50:58.080 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:58.079+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:58.126 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.126 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:50:58.218 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:58.217+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:58.243 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-12T21:50:58.279 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.280 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.282 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:58.281+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:58.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:50:58.383 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:58.381+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.399 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:50:58.484 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:58.483+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:58.550 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.551 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:50:58.585 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:58.583+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:58.661 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.661 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:50:58.686 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:58.685+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:58.779 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.780 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.787 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:58.785+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:58.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:50:58.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:50:58.887 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:58.885+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:58.931 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:50:58.931 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:50:58.940 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:50:58.997 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:50:58.997 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:50:59.015 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:50:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:50:59.024 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:59.023+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:59.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:50:59.032 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:50:59.086 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:50:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-09-12T21:50:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-09-12T21:50:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:50:59.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4147.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:30.773384+0000", 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.310771789, 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054099760000000004, 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773384+0000", 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773384+0000", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773385+0000", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9699999999999996e-07 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773462+0000", 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6961999999999999e-05 2024-09-12T21:50:59.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773474+0000", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1508000000000001e-05 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773479+0000", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9899999999999997e-06 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773514+0000", 2024-09-12T21:50:59.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5485999999999999e-05 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.773526+0000", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1907e-05 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.778762+0000", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005235778 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.778794+0000", 2024-09-12T21:50:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2747999999999999e-05 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4147.0:84 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'54, mlcod=10'50)", 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:30.796188+0000", 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.287968071000002, 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056643529999999996, 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796188+0000", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796188+0000", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796189+0000", 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3900000000000004e-07 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796254+0000", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5041000000000003e-05 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796263+0000", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4069999999999999e-06 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796275+0000", 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1698e-05 2024-09-12T21:50:59.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796310+0000", 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5505e-05 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.796323+0000", 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2835e-05 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.801819+0000", 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054957549999999997 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.801853+0000", 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3473000000000003e-05 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4147.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-09-12T21:50:59.095 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:30.919615+0000", 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.164541279000002, 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005535234, 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919615+0000", 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919615+0000", 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919616+0000", 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2600000000000002e-07 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919675+0000", 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9212999999999997e-05 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919684+0000", 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9940000000000006e-06 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919688+0000", 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2780000000000004e-06 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919725+0000", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6616999999999999e-05 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.919736+0000", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1676e-05 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.925113+0000", 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053762050000000002 2024-09-12T21:50:59.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:30.925150+0000", 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7625e-05 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235550657000001, 2024-09-12T21:50:59.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089271869999999996, 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848615+0000", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0620000000000007e-06 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848623+0000", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9920000000000007e-06 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848634+0000", 2024-09-12T21:50:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1099e-05 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848644+0000", 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0182e-05 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848700+0000", 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6530000000000003e-05 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848847+0000", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000146491 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848996+0000", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148947 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851803+0000", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028072689999999998 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857449+0000", 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056455899999999998 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857495+0000", 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6581e-05 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857533+0000", 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7444000000000003e-05 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.105 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235490261999999, 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009915063, 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848667+0000", 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4e-07 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848671+0000", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.755e-06 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848678+0000", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.289e-06 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848684+0000", 2024-09-12T21:50:59.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.789e-06 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849321+0000", 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063725800000000003 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849421+0000", 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010059 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849567+0000", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014592699999999999 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853432+0000", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003864648 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858460+0000", 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050281609999999997 2024-09-12T21:50:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858537+0000", 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7253e-05 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858581+0000", 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3553000000000001e-05 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235453186000001, 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085681980000000008, 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848704+0000", 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6899999999999997e-07 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848711+0000", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3780000000000003e-06 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848729+0000", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7711999999999999e-05 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848735+0000", 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6630000000000004e-06 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849316+0000", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058050799999999998 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849449+0000", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013346000000000001 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849567+0000", 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118083 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853424+0000", 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038564519999999998 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857133+0000", 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003708842 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857189+0000", 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6548000000000001e-05 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857271+0000", 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1983000000000004e-05 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.117 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235410559999998, 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009824536, 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:50:59.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7499999999999999e-07 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848750+0000", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3100000000000001e-06 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848758+0000", 2024-09-12T21:50:59.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.106e-06 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848763+0000", 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2129999999999999e-06 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850769+0000", 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020063220000000001 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850849+0000", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9589e-05 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850999+0000", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150214 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.854768+0000", 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037683769999999998 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858485+0000", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037178250000000001 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858529+0000", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4088999999999997e-05 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858570+0000", 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0716000000000001e-05 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.122 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235378178000001, 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079339300000000005, 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848779+0000", 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:50:59.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848782+0000", 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6490000000000001e-06 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848789+0000", 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8399999999999997e-06 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848797+0000", 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3719999999999999e-06 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848850+0000", 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3826999999999998e-05 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848969+0000", 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118789 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849091+0000", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012203 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851284+0000", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021923160000000001 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856617+0000", 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053338480000000004 2024-09-12T21:50:59.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856672+0000", 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4969999999999997e-05 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856712+0000", 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9650999999999997e-05 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235340229999998, 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080347249999999995, 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848817+0000", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0299999999999999e-07 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848821+0000", 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1620000000000001e-06 2024-09-12T21:50:59.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848835+0000", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3896e-05 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848841+0000", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6590000000000001e-06 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849417+0000", 2024-09-12T21:50:59.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057565199999999996 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849515+0000", 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7572999999999996e-05 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849696+0000", 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181528 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.854931+0000", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052347330000000001 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856765+0000", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018337379999999999 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856812+0000", 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7061999999999998e-05 2024-09-12T21:50:59.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856851+0000", 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9119000000000003e-05 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235301052000001, 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009863017, 2024-09-12T21:50:59.134 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848856+0000", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9999999999999998e-07 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848858+0000", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.633e-06 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848872+0000", 2024-09-12T21:50:59.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3548e-05 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848877+0000", 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6420000000000004e-06 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850811+0000", 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019336780000000001 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850962+0000", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001507 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851230+0000", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026819799999999998 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857851+0000", 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006621226 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858635+0000", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00078337199999999995 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858682+0000", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6984999999999998e-05 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858718+0000", 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6634999999999997e-05 2024-09-12T21:50:59.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235271416, 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081207889999999998, 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848895+0000", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.713e-06 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848900+0000", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1549999999999998e-06 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848904+0000", 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.388e-06 2024-09-12T21:50:59.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848944+0000", 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0172000000000001e-05 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849026+0000", 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2612000000000001e-05 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857006+0000", 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079791889999999994 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.235244390999998, 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081901600000000001, 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:50:59.144 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:50:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4899999999999995e-07 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848915+0000", 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4820000000000001e-06 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848921+0000", 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4779999999999996e-06 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848928+0000", 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.99e-06 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848975+0000", 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6208999999999998e-05 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849056+0000", 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1049000000000003e-05 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857102+0000", 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080464030000000006 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.850952+0000", 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.233204219000001, 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0068301330000000004, 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.148 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850952+0000", 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850952+0000", 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850952+0000", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1899999999999998e-07 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850956+0000", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7960000000000002e-06 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850963+0000", 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7880000000000001e-06 2024-09-12T21:50:59.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850968+0000", 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9060000000000001e-06 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851565+0000", 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00059681899999999995 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851581+0000", 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6631000000000001e-05 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857736+0000", 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061544570000000003 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857782+0000", 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6417e-05 2024-09-12T21:50:59.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:31 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.851539+0000", 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.232617690000001, 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064805690000000003, 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851539+0000", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851539+0000", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851539+0000", 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2799999999999996e-07 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851561+0000", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1532e-05 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851569+0000", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2330000000000006e-06 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851577+0000", 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5089999999999993e-06 2024-09-12T21:50:59.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851941+0000", 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00036345099999999999 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851960+0000", 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9154e-05 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857988+0000", 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006028177 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858019+0000", 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0885e-05 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T21:50:59.157 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.851778+0000", 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.232377903, 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059956009999999997, 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851778+0000", 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851778+0000", 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851779+0000", 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5600000000000005e-07 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851784+0000", 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9339999999999997e-06 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851795+0000", 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0587e-05 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851801+0000", 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7170000000000002e-06 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851850+0000", 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8380000000000001e-05 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851876+0000", 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6319999999999999e-05 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857721+0000", 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058446239999999997 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857774+0000", 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3383e-05 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.851943+0000", 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.232213256000001, 2024-09-12T21:50:59.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059734610000000002, 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851943+0000", 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851943+0000", 2024-09-12T21:50:59.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851944+0000", 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2699999999999999e-07 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851962+0000", 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8283000000000001e-05 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851970+0000", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6129999999999998e-06 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851977+0000", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7419999999999997e-06 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852041+0000", 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4128000000000007e-05 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852061+0000", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9279e-05 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857857+0000", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057961710000000001 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857916+0000", 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9518000000000002e-05 2024-09-12T21:50:59.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.852283+0000", 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.231872807999999, 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061159589999999998, 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852283+0000", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852283+0000", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852284+0000", 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7100000000000002e-07 2024-09-12T21:50:59.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852288+0000", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8689999999999997e-06 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852294+0000", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.421e-06 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852300+0000", 2024-09-12T21:50:59.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7559999999999996e-06 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853582+0000", 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001282427 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853822+0000", 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000239912 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858302+0000", 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044794659999999997 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858399+0000", 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7637e-05 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.852409+0000", 2024-09-12T21:50:59.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.231746977, 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056360899999999998, 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852409+0000", 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852409+0000", 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852409+0000", 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2700000000000001e-07 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852416+0000", 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.883e-06 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852430+0000", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3963e-05 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852446+0000", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5820000000000001e-05 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853078+0000", 2024-09-12T21:50:59.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063156900000000001 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858045+0000", 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004967628 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.852459+0000", 2024-09-12T21:50:59.175 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.231696825, 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057123299999999998, 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852459+0000", 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852459+0000", 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852460+0000", 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0199999999999998e-07 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852469+0000", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3330000000000003e-06 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852493+0000", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4235000000000001e-05 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.852499+0000", 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0190000000000003e-06 2024-09-12T21:50:59.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853174+0000", 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00067451200000000005 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853192+0000", 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8088999999999999e-05 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858138+0000", 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049464330000000001 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858172+0000", 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3407e-05 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T21:50:59.180 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.853114+0000", 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.231041999999999, 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053455630000000002, 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853114+0000", 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853114+0000", 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853115+0000", 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0999999999999999e-07 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853131+0000", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6305999999999999e-05 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853328+0000", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019751999999999999 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853345+0000", 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6303e-05 2024-09-12T21:50:59.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853691+0000", 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034662499999999998 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853723+0000", 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1597000000000003e-05 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:50:59.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858326+0000", 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046028730000000004 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858460+0000", 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000133929 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:50:59.187 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:50:59.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:50:59.190 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:59.187+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:59.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:50:59.261 DEBUG:teuthology.orchestra.run.smithi053:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-12T21:50:59.289 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:50:59.288+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:50:59.302 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-12T21:50:59.314 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-12T21:50:59.315 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-12T21:50:59.316 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:50:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:50:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-12T21:50:59.316 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:50:59.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:50:59.353 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:hints = 1 2024-09-12T21:50:59.353 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-12T21:50:59.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Object prefix: benchmark_data_smithi053_32461 2024-09-12T21:50:59.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T21:50:59.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 0 0 0 0 0 0 - 0 2024-09-12T21:50:59.390 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:59.388+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:59.491 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:59.489+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:59.493 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:50:59.493 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:50:59.493 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:50:59.493 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:50:59.494 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:50:59.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:50:59.592 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:59.590+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:59.649 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:50:59.649 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:50:59.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:50:59.649 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.056791+0000", 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.587114014000001, 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091677879999999996, 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 136 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056791+0000", 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056791+0000", 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056791+0000", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.05e-07 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056793+0000", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0490000000000002e-06 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056796+0000", 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0850000000000001e-06 2024-09-12T21:50:59.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056799+0000", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6560000000000001e-06 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.062299+0000", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0054998590000000002 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.062370+0000", 2024-09-12T21:50:59.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0831e-05 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.062489+0000", 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011985900000000001 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065451+0000", 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029620150000000001 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065887+0000", 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00043517300000000002 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065925+0000", 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8828999999999997e-05 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065959+0000", 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3226999999999999e-05 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.056820+0000", 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.587084467, 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092207390000000004, 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.656 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 137 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056820+0000", 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056820+0000", 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056821+0000", 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056927+0000", 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010650300000000001 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056935+0000", 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0160000000000008e-06 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056941+0000", 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9680000000000003e-06 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.062975+0000", 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060331489999999998 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063022+0000", 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.791e-05 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063092+0000", 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9438999999999997e-05 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065831+0000", 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027388740000000001 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065966+0000", 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013538499999999999 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066005+0000", 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8518e-05 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066041+0000", 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.65e-05 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.056955+0000", 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.586950177999999, 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091635339999999992, 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 138 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.663 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056955+0000", 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056955+0000", 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056955+0000", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056959+0000", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.766e-06 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056967+0000", 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5650000000000004e-06 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056971+0000", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7099999999999998e-06 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063560+0000", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0065886410000000001 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063607+0000", 2024-09-12T21:50:59.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6854999999999998e-05 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063678+0000", 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1126999999999998e-05 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065875+0000", 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021970380000000001 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066048+0000", 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000173246 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066086+0000", 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7669000000000001e-05 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066118+0000", 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2379000000000003e-05 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.056981+0000", 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.586923911, 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092351810000000003, 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 139 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056981+0000", 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056981+0000", 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056981+0000", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.46e-07 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056985+0000", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.196e-06 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056993+0000", 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9270000000000005e-06 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.056998+0000", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0799999999999996e-06 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.063945+0000", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0069471000000000003 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064016+0000", 2024-09-12T21:50:59.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1044999999999995e-05 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064125+0000", 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109536 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066125+0000", 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019998519999999999 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066152+0000", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6965999999999999e-05 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066182+0000", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9379000000000001e-05 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066216+0000", 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4653999999999997e-05 2024-09-12T21:50:59.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.057011+0000", 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.586893564, 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0093250520000000003, 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 140 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057011+0000", 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057011+0000", 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057012+0000", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3099999999999998e-07 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057063+0000", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0861e-05 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057071+0000", 2024-09-12T21:50:59.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7020000000000007e-06 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057078+0000", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1979999999999998e-06 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064420+0000", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0073420969999999997 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064485+0000", 2024-09-12T21:50:59.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5659000000000003e-05 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064553+0000", 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8015999999999994e-05 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066131+0000", 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015776379999999999 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066259+0000", 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012811100000000001 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066306+0000", 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6440000000000003e-05 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066336+0000", 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0898999999999997e-05 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.057087+0000", 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.586817595999999, 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0093474700000000001, 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 141 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.681 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057087+0000", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057087+0000", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057088+0000", 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2300000000000001e-07 2024-09-12T21:50:59.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057092+0000", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.681e-06 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057099+0000", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.126e-06 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.057104+0000", 2024-09-12T21:50:59.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7320000000000003e-06 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.064981+0000", 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0078767769999999997 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065069+0000", 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8187000000000001e-05 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.065182+0000", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112988 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066347+0000", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001164134 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066372+0000", 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5519000000000001e-05 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066398+0000", 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5863999999999998e-05 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.066435+0000", 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6838999999999997e-05 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.686 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.348376+0000", 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.295528690000001, 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091787320000000002, 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 187 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348376+0000", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348376+0000", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348377+0000", 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348381+0000", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1010000000000002e-06 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348388+0000", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6699999999999997e-06 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348392+0000", 2024-09-12T21:50:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8119999999999998e-06 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354307+0000", 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059149119999999996 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354355+0000", 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7868000000000003e-05 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354428+0000", 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2527999999999994e-05 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.355993+0000", 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015654989999999999 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357466+0000", 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001472723 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357518+0000", 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1962999999999997e-05 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357555+0000", 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7106e-05 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.348407+0000", 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.295498308999999, 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092278940000000004, 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 188 2024-09-12T21:50:59.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348407+0000", 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348407+0000", 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348407+0000", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3000000000000001e-07 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348454+0000", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7292000000000001e-05 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348462+0000", 2024-09-12T21:50:59.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6979999999999998e-06 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348467+0000", 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3380000000000004e-06 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354826+0000", 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063585630000000002 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354904+0000", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8431999999999997e-05 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.354998+0000", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3592999999999997e-05 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.355998+0000", 2024-09-12T21:50:59.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00100044 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357589+0000", 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015907860000000001 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357616+0000", 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6267000000000001e-05 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357635+0000", 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8955000000000001e-05 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:31.348484+0000", 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.295420927999999, 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092621690000000007, 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4147", 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/127209600", 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 189 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348484+0000", 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348484+0000", 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348485+0000", 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1600000000000001e-07 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348488+0000", 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5140000000000002e-06 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348495+0000", 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8349999999999998e-06 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.348500+0000", 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1309999999999997e-06 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.355544+0000", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0070434690000000001 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.355614+0000", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0296999999999995e-05 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.355729+0000", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115596 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.356630+0000", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00090036399999999996 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357670+0000", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001040238 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357714+0000", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4116000000000002e-05 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:31.357746+0000", 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1992999999999997e-05 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4227.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:34.714001+0000", 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 24.929903864, 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091918109999999994, 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.705 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4227", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1841756448", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 1 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714001+0000", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714001+0000", 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714002+0000", 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.254e-06 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714008+0000", 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2220000000000001e-06 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714017+0000", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7079999999999992e-06 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714024+0000", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.827e-06 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714087+0000", 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3392999999999994e-05 2024-09-12T21:50:59.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.714095+0000", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7370000000000006e-06 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.718086+0000", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039908849999999996 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.718209+0000", 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012301599999999999 2024-09-12T21:50:59.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.718353+0000", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014368000000000001 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.719154+0000", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00080157999999999998 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.723098+0000", 2024-09-12T21:50:59.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039439439999999996 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.723151+0000", 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2207999999999999e-05 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:34.723193+0000", 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2357000000000001e-05 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848028+0000", 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795877390000001, 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0095034620000000007, 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848028+0000", 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848028+0000", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848029+0000", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.778e-06 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848049+0000", 2024-09-12T21:50:59.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9979e-05 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848061+0000", 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2003e-05 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848074+0000", 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2439999999999999e-05 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848289+0000", 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021522499999999999 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848623+0000", 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00033439299999999999 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848791+0000", 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016783600000000001 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856245+0000", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0074538340000000003 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857451+0000", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012062080000000001 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857487+0000", 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5685000000000001e-05 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857531+0000", 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4081e-05 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848097+0000", 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795808193999999, 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010083491, 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848097+0000", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848097+0000", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848098+0000", 2024-09-12T21:50:59.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848105+0000", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1180000000000003e-06 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848145+0000", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0107000000000001e-05 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848154+0000", 2024-09-12T21:50:59.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4089999999999992e-06 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850035+0000", 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001880882 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850116+0000", 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0420999999999995e-05 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850235+0000", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119232 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857560+0000", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007325575 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858117+0000", 2024-09-12T21:50:59.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00055674700000000001 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858154+0000", 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.663e-05 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858180+0000", 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6478e-05 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795735819000001, 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01083307, 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848170+0000", 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9999999999999996e-07 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848181+0000", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.099e-05 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848189+0000", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0569999999999993e-06 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848196+0000", 2024-09-12T21:50:59.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9700000000000002e-06 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851110+0000", 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029139919999999998 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851270+0000", 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000159734 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851394+0000", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012404699999999999 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857752+0000", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006358084 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858944+0000", 2024-09-12T21:50:59.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001192303 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858978+0000", 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4144999999999999e-05 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859002+0000", 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3947999999999998e-05 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795589687, 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011134068, 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848316+0000", 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2900000000000002e-07 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848321+0000", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9509999999999997e-06 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848330+0000", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5259999999999993e-06 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848339+0000", 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0450000000000006e-06 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851994+0000", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036549239999999999 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.852274+0000", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027998600000000003 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.852419+0000", 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014527799999999999 2024-09-12T21:50:59.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857776+0000", 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005356675 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859391+0000", 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016153300000000001 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859422+0000", 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1602e-05 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859449+0000", 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6821999999999998e-05 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:50:59.734 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795553186999999, 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011189774, 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:50:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848356+0000", 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3299999999999999e-06 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848371+0000", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.501e-05 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848419+0000", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8204000000000001e-05 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.853929+0000", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005509931 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.854057+0000", 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128388 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.854258+0000", 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020107299999999999 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857780+0000", 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003522234 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859486+0000", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001705856 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859516+0000", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9249000000000001e-05 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859542+0000", 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5998000000000001e-05 2024-09-12T21:50:59.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795466712, 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011182694, 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848439+0000", 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:50:59.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848453+0000", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4175999999999999e-05 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848460+0000", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2620000000000001e-06 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848468+0000", 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5549999999999997e-06 2024-09-12T21:50:59.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855111+0000", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066429990000000001 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855224+0000", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011350599999999999 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855354+0000", 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000129598 2024-09-12T21:50:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857786+0000", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024317010000000001 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859569+0000", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001783736 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859600+0000", 2024-09-12T21:50:59.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0341999999999999e-05 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859621+0000", 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1084999999999999e-05 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795426742, 2024-09-12T21:50:59.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011223219, 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848479+0000", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848483+0000", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6370000000000001e-06 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848490+0000", 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9519999999999994e-06 2024-09-12T21:50:59.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848498+0000", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856289+0000", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0077910210000000004 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856454+0000", 2024-09-12T21:50:59.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000165184 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856547+0000", 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3060999999999996e-05 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857794+0000", 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001246877 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859649+0000", 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018552449999999999 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859679+0000", 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9784000000000001e-05 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859701+0000", 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2636000000000001e-05 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.795399668999998, 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014234999, 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:50:59.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848506+0000", 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848508+0000", 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.334e-06 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848513+0000", 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6990000000000002e-06 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848516+0000", 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6349999999999999e-06 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856735+0000", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082186740000000005 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856800+0000", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5495999999999998e-05 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856936+0000", 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013602300000000001 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859761+0000", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028247319999999999 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862641+0000", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028799590000000001 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862699+0000", 2024-09-12T21:50:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7525999999999998e-05 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862740+0000", 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1545000000000003e-05 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.849569+0000", 2024-09-12T21:50:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.794336048000002, 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010100602, 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849569+0000", 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849569+0000", 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849570+0000", 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5899999999999995e-07 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849584+0000", 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4311000000000001e-05 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849595+0000", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0824e-05 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849603+0000", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7689999999999996e-06 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856379+0000", 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0067766980000000003 2024-09-12T21:50:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856501+0000", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121648 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856577+0000", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5678000000000003e-05 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857788+0000", 2024-09-12T21:50:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012112690000000001 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859605+0000", 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001816771 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859641+0000", 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6588999999999998e-05 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859669+0000", 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8186000000000001e-05 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.793924316000002, 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01277415, 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:50:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:50:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849982+0000", 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849986+0000", 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7110000000000003e-06 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849998+0000", 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1647e-05 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850005+0000", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1559999999999998e-06 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856859+0000", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068537160000000001 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857053+0000", 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019449800000000001 2024-09-12T21:50:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862755+0000", 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057013819999999996 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:50:59.766 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:50:59.767 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:50:59.765+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:50:59.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:50:59.869 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:59.867+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:50:59.922 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:50:59.922 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:50:59.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2843 5.3 5:cf91f1b7:::benchmark_data_smithi053_32461_object2842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.919702+0000", 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001477896, 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001502719, 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2843 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919702+0000", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919702+0000", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919703+0000", 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3799999999999997e-07 2024-09-12T21:50:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919809+0000", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010598 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919817+0000", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2609999999999993e-06 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919823+0000", 2024-09-12T21:50:59.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0719999999999996e-06 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919873+0000", 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9687e-05 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919973+0000", 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100257 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920049+0000", 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5615e-05 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920608+0000", 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000559108 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2845 5.a 5:56fd9baf:::benchmark_data_smithi053_32461_object2844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.919844+0000", 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001336751, 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001412815, 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2845 2024-09-12T21:50:59.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919844+0000", 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919844+0000", 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919844+0000", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.92e-07 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919922+0000", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7327e-05 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919929+0000", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9480000000000002e-06 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919934+0000", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8950000000000003e-06 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.919971+0000", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6545999999999999e-05 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920044+0000", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2776999999999998e-05 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920115+0000", 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1149000000000006e-05 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2841 5.e e23/21 5:7aadf344:::benchmark_data_smithi053_32461_object2840:head v 23'169, mlcod=23'166)", 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920078+0000", 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011026149999999999, 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012164039999999999, 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920078+0000", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920078+0000", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920078+0000", 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-07 2024-09-12T21:50:59.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920153+0000", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5217999999999997e-05 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920160+0000", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3709999999999996e-06 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920166+0000", 2024-09-12T21:50:59.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1140000000000002e-06 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920201+0000", 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4848999999999998e-05 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920218+0000", 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6994e-05 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2848 5.a 5:54e3b4ef:::benchmark_data_smithi053_32461_object2847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920129+0000", 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010516259999999999, 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011986970000000001, 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2848 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920129+0000", 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920129+0000", 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920129+0000", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1399999999999996e-07 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920207+0000", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7175999999999994e-05 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920215+0000", 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7770000000000008e-06 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920222+0000", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7220000000000002e-06 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920490+0000", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026766600000000001 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920600+0000", 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110454 2024-09-12T21:50:59.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920725+0000", 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124406 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2849 5.5 5:a4518fe8:::benchmark_data_smithi053_32461_object2848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920296+0000", 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00088390799999999998, 2024-09-12T21:50:59.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00107132, 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2849 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920296+0000", 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920296+0000", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920297+0000", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920428+0000", 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013100500000000001 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920436+0000", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920443+0000", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6189999999999996e-06 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920500+0000", 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6762999999999998e-05 2024-09-12T21:50:59.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920599+0000", 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9568000000000006e-05 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920725+0000", 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125186 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2846 5.2 e23/21 5:4ccd086f:::benchmark_data_smithi053_32461_object2845:head v 23'182, mlcod=23'180)", 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920281+0000", 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00089969400000000004, 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001123584, 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920281+0000", 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920281+0000", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920281+0000", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8400000000000004e-07 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920478+0000", 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019708799999999999 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920486+0000", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4529999999999996e-06 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920491+0000", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2780000000000001e-06 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920525+0000", 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3760000000000002e-05 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920542+0000", 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7597000000000001e-05 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2847 5.e e23/21 5:7a32c4ef:::benchmark_data_smithi053_32461_object2846:head v 23'170, mlcod=23'166)", 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920572+0000", 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00060811100000000005, 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00086610099999999998, 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920572+0000", 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920572+0000", 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920573+0000", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6300000000000005e-07 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920638+0000", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5463999999999995e-05 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920644+0000", 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1909999999999997e-06 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920648+0000", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.625e-06 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920681+0000", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2564000000000002e-05 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920692+0000", 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1034e-05 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2851 5.c 5:3b826a71:::benchmark_data_smithi053_32461_object2850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920686+0000", 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00049427, 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079322799999999999, 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2851 2024-09-12T21:50:59.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920686+0000", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920686+0000", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920687+0000", 2024-09-12T21:50:59.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1399999999999996e-07 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920774+0000", 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7188999999999995e-05 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920784+0000", 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8220000000000002e-06 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920790+0000", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.195e-06 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920838+0000", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7460000000000003e-05 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920970+0000", 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132817 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921089+0000", 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011822100000000001 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:2852 5.c 5:32268037:::benchmark_data_smithi053_32461_object2851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.920806+0000", 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000374693, 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071158799999999998, 2024-09-12T21:50:59.956 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2852 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920806+0000", 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920806+0000", 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920806+0000", 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.06e-07 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920837+0000", 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0505999999999999e-05 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920844+0000", 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.559e-06 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.920850+0000", 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7450000000000001e-06 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921461+0000", 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00061074499999999999 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2850 5.2 e23/21 5:4fd652ff:::benchmark_data_smithi053_32461_object2849:head v 23'183, mlcod=23'180)", 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.921155+0000", 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.5797000000000001e-05, 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039276600000000001, 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921155+0000", 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921155+0000", 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921155+0000", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7199999999999999e-07 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921221+0000", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5909999999999997e-05 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921231+0000", 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0046e-05 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921237+0000", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.908e-06 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921290+0000", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3470000000000001e-05 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921302+0000", 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1953999999999999e-05 2024-09-12T21:50:59.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2853 5.7 e23/21 5:ec096c39:::benchmark_data_smithi053_32461_object2852:head v 23'205, mlcod=23'203)", 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.921339+0000", 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998417, 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023973500000000001, 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921339+0000", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921339+0000", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921339+0000", 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4000000000000002e-07 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921396+0000", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7349999999999998e-05 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921406+0000", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.011e-05 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921413+0000", 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3099999999999997e-06 2024-09-12T21:50:59.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921465+0000", 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1969999999999999e-05 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.921485+0000", 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0126e-05 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:50:59.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:50:59.968 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:50:59.968 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:50:59.968 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:50:59.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:50:59.970 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:50:59.969+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:00.071 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:00.069+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:00.122 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:00.123 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:00.135 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:00.176 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:00.174+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:51:00.273 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:00.271+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:00.332 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:00.332 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:00.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:00.332 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481479899, 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081578469999999993, 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:00.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848215+0000", 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7260000000000002e-06 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848226+0000", 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1192000000000001e-05 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848240+0000", 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4191e-05 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848253+0000", 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2529e-05 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848580+0000", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000327855 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848723+0000", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014282300000000001 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848931+0000", 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020801000000000001 2024-09-12T21:51:00.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851890+0000", 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029591679999999999 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856045+0000", 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041549500000000001 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856324+0000", 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027864200000000001 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856368+0000", 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3761000000000003e-05 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481408198, 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088897950000000007, 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4399999999999999e-07 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848288+0000", 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-12T21:51:00.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848297+0000", 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7820000000000005e-06 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848305+0000", 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5510000000000002e-06 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849672+0000", 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013672809999999999 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849781+0000", 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108804 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849953+0000", 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172146 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852364+0000", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024108469999999998 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857078+0000", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047140289999999998 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857134+0000", 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.622e-05 2024-09-12T21:51:00.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857171+0000", 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7138999999999998e-05 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:00.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481374941999999, 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275378, 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2600000000000002e-07 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848319+0000", 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8349999999999997e-06 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848327+0000", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.515e-06 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848333+0000", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1140000000000002e-06 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849652+0000", 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013191279999999999 2024-09-12T21:51:00.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849852+0000", 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019977499999999999 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.850544+0000", 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069252699999999996 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852835+0000", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002291066 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858497+0000", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056611939999999996 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858556+0000", 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9769000000000003e-05 2024-09-12T21:51:00.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858590+0000", 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3929e-05 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481281585000001, 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010318723, 2024-09-12T21:51:00.350 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848412+0000", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9430000000000002e-06 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848420+0000", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5299999999999999e-06 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848432+0000", 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2034e-05 2024-09-12T21:51:00.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848442+0000", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0146000000000001e-05 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851061+0000", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002619148 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851127+0000", 2024-09-12T21:51:00.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6292999999999997e-05 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851221+0000", 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3215999999999997e-05 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852900+0000", 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001679301 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858673+0000", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005772732 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858706+0000", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3055000000000001e-05 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858727+0000", 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1325e-05 2024-09-12T21:51:00.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481233704000001, 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088434919999999997, 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848457+0000", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-07 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848462+0000", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848469+0000", 2024-09-12T21:51:00.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3849999999999996e-06 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848483+0000", 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3973e-05 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851408+0000", 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029247980000000002 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851478+0000", 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9609000000000004e-05 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851566+0000", 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8492999999999995e-05 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852975+0000", 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001409291 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857213+0000", 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042380200000000003 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857264+0000", 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0946000000000003e-05 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857300+0000", 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5271000000000002e-05 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481194720000001, 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084995899999999996, 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848496+0000", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848502+0000", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6729999999999997e-06 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848509+0000", 2024-09-12T21:51:00.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.148e-06 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848515+0000", 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5660000000000003e-06 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848635+0000", 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001197 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848765+0000", 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027000000000001 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848927+0000", 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161402 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851255+0000", 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002328653 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856931+0000", 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056754249999999996 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856964+0000", 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3800000000000002e-05 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856995+0000", 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0258999999999999e-05 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481156917, 2024-09-12T21:51:00.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085654359999999992, 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848534+0000", 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3200000000000005e-07 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848537+0000", 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848548+0000", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0044000000000001e-05 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848555+0000", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849607+0000", 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010520379999999999 2024-09-12T21:51:00.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849729+0000", 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012258200000000001 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857098+0000", 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073691379999999999 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481105055, 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088320069999999994, 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848586+0000", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4780000000000001e-06 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848591+0000", 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-12T21:51:00.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848627+0000", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5617000000000001e-05 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848646+0000", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8958999999999999e-05 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851908+0000", 2024-09-12T21:51:00.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032625140000000002 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852028+0000", 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119589 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857417+0000", 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053888210000000002 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.481025252999999, 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099012079999999999, 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:00.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848668+0000", 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8e-06 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848679+0000", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936e-05 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848691+0000", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1807999999999999e-05 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848698+0000", 2024-09-12T21:51:00.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9059999999999996e-06 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849038+0000", 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000339527 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849171+0000", 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013372899999999999 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858566+0000", 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093945020000000008 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:252 5.a 5:528876aa:::benchmark_data_smithi053_32461_object251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.414485+0000", 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.91520477200000006, 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067366099999999996, 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414485+0000", 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414485+0000", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414486+0000", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5199999999999995e-07 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414569+0000", 2024-09-12T21:51:00.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2624e-05 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414577+0000", 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7250000000000003e-06 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414584+0000", 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3670000000000002e-06 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414646+0000", 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2120999999999997e-05 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414740+0000", 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4184999999999994e-05 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.414834+0000", 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3716999999999997e-05 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.415628+0000", 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079455499999999996 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.421167+0000", 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055382950000000004 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.421196+0000", 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9215000000000001e-05 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.421222+0000", 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5854e-05 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:594 5.a 5:519c981a:::benchmark_data_smithi053_32461_object593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.387 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.84116548999999996, 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081029229999999997, 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 594 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488525+0000", 2024-09-12T21:51:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488660+0000", 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013510599999999999 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488680+0000", 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9768000000000001e-05 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488688+0000", 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5190000000000003e-06 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488730+0000", 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2122000000000001e-05 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488845+0000", 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115812 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488975+0000", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012919299999999999 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.492876+0000", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039010780000000001 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496577+0000", 2024-09-12T21:51:00.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037008499999999999 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496606+0000", 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8897000000000001e-05 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496627+0000", 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1798e-05 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:728 5.5 5:afefb132:::benchmark_data_smithi053_32461_object727:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.519667+0000", 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.81002267100000003, 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064754549999999998, 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 728 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.519667+0000", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.519667+0000", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.519668+0000", 2024-09-12T21:51:00.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520055+0000", 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000387143 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520064+0000", 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5299999999999996e-06 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520070+0000", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1009999999999997e-06 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520114+0000", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4688999999999999e-05 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520212+0000", 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8055999999999998e-05 2024-09-12T21:51:00.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.520335+0000", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012243000000000001 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.521377+0000", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010423590000000001 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.526065+0000", 2024-09-12T21:51:00.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046873720000000004 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.526109+0000", 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4795000000000001e-05 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.526143+0000", 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3290000000000001e-05 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:761 5.5 5:ac487c3c:::benchmark_data_smithi053_32461_object760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.80263273800000001, 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070621049999999999, 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 761 2024-09-12T21:51:00.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527058+0000", 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2900000000000003e-07 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527117+0000", 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8894000000000002e-05 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527125+0000", 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4479999999999994e-06 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527132+0000", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527749+0000", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00061702700000000003 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527910+0000", 2024-09-12T21:51:00.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016116700000000001 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.528044+0000", 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013416 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.528740+0000", 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069650500000000004 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534068+0000", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053279019999999998 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534099+0000", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0352999999999999e-05 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534119+0000", 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0602e-05 2024-09-12T21:51:00.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:834 5.a 5:59423f51:::benchmark_data_smithi053_32461_object833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.542908+0000", 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.78678153500000003, 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070408529999999997, 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 834 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542908+0000", 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542908+0000", 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542909+0000", 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542947+0000", 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7975999999999997e-05 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542959+0000", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2466000000000001e-05 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.542966+0000", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4960000000000001e-06 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.543152+0000", 2024-09-12T21:51:00.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186317 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.543247+0000", 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5230999999999997e-05 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.543376+0000", 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012838300000000001 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.544528+0000", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011522990000000001 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.549791+0000", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052626859999999999 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.549888+0000", 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7209999999999999e-05 2024-09-12T21:51:00.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.549949+0000", 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1159000000000002e-05 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:883 5.a 5:57814417:::benchmark_data_smithi053_32461_object882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.77733062799999997, 2024-09-12T21:51:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007478452, 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 883 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552360+0000", 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552419+0000", 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9039999999999997e-05 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552426+0000", 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9909999999999996e-06 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552430+0000", 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2119999999999997e-06 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552480+0000", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9509000000000003e-05 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552595+0000", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011496499999999999 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552728+0000", 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013377800000000001 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.556484+0000", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037559350000000002 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559748+0000", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032636570000000001 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559798+0000", 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0269000000000003e-05 2024-09-12T21:51:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559838+0000", 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9515999999999999e-05 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:1391 5.a 5:5eab0a78:::benchmark_data_smithi053_32461_object1390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.68277097899999994, 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076745870000000001, 2024-09-12T21:51:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646920+0000", 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7400000000000002e-07 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647025+0000", 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104975 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647033+0000", 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647041+0000", 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1100000000000003e-06 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647091+0000", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9650000000000001e-05 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647230+0000", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013927899999999999 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647366+0000", 2024-09-12T21:51:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013627600000000001 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.648521+0000", 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011550600000000001 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654539+0000", 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060172610000000003 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654570+0000", 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1333e-05 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654593+0000", 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3567999999999999e-05 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:2188 5.2 e23/21 5:40066f4d:::benchmark_data_smithi053_32461_object2187:head v 23'144, mlcod=23'141)", 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.799077+0000", 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.53061294800000003, 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006708276, 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799077+0000", 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799077+0000", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799077+0000", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1699999999999999e-07 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799136+0000", 2024-09-12T21:51:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8700999999999999e-05 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799145+0000", 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2080000000000006e-06 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799153+0000", 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2960000000000001e-06 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799191+0000", 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8855e-05 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.799209+0000", 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7818000000000001e-05 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.805739+0000", 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065296520000000004 2024-09-12T21:51:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.805785+0000", 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6329000000000003e-05 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3126 5.4 e23/21 5:25901752:::benchmark_data_smithi053_32461_object3125:head v 23'180, mlcod=23'178)", 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.360057291, 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078331400000000006, 2024-09-12T21:51:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-07 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969880+0000", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024677 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969888+0000", 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2630000000000003e-06 2024-09-12T21:51:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969895+0000", 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3860000000000004e-06 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969938+0000", 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3095e-05 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969960+0000", 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2192999999999999e-05 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977423+0000", 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074631740000000004 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977466+0000", 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2656e-05 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3127 5.4 e23/21 5:248d44ab:::benchmark_data_smithi053_32461_object3126:head v 23'181, mlcod=23'178)", 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.35936337299999999, 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007182323, 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970327+0000", 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-07 2024-09-12T21:51:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970352+0000", 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5729e-05 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970357+0000", 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7679999999999999e-06 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970360+0000", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8210000000000002e-06 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970390+0000", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-05 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970401+0000", 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1003e-05 2024-09-12T21:51:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977469+0000", 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070674819999999999 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977509+0000", 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9861999999999999e-05 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3289 5.2 e23/21 5:47917739:::benchmark_data_smithi053_32461_object3288:head v 23'217, mlcod=23'214)", 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.328769111, 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075174889999999996, 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4000000000000002e-07 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001015+0000", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4188e-05 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001024+0000", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7199999999999995e-06 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001031+0000", 2024-09-12T21:51:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4300000000000003e-06 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001088+0000", 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7067000000000001e-05 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001123+0000", 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.008406+0000", 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072824389999999999 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.008438+0000", 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2435999999999999e-05 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:00.443 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:00.445 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:00.443+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:00.446 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'squid'} 2024-09-12T21:51:00.446 DEBUG:teuthology.orchestra.run.smithi053:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=squid' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T21:51:00.446 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 1 16 5178 5162 322.606 322.625 0.00298603 0.00309133 2024-09-12T21:51:00.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:00.546 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:00.545+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:6423 5.8 5:10cd5a35:::benchmark_data_smithi053_32461_object6422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.593411+0000", 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00093872499999999995, 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00095769699999999998, 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 6423 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593411+0000", 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593411+0000", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593412+0000", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593442+0000", 2024-09-12T21:51:00.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9950999999999998e-05 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593450+0000", 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.79e-06 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593456+0000", 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9909999999999999e-06 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593494+0000", 2024-09-12T21:51:00.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8763000000000001e-05 2024-09-12T21:51:00.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593566+0000", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1692000000000004e-05 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593641+0000", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4883999999999997e-05 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594176+0000", 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00053527999999999996 2024-09-12T21:51:00.600 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:6425 5.b 5:d691eb16:::benchmark_data_smithi053_32461_object6424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.593468+0000", 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00088153899999999998, 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00095134400000000002, 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:00.601 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 6425 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593468+0000", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593468+0000", 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593469+0000", 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7899999999999998e-07 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593533+0000", 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3730000000000001e-05 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593541+0000", 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2519999999999999e-06 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593548+0000", 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9689999999999997e-06 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593583+0000", 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916999999999998e-05 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593652+0000", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9290999999999998e-05 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593734+0000", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1865000000000003e-05 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594326+0000", 2024-09-12T21:51:00.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00059206000000000005 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:6432 5.d 5:b4b29101:::benchmark_data_smithi053_32461_object6431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.593996+0000", 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00035426199999999999, 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046826000000000002, 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:00.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 6432 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593996+0000", 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593996+0000", 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593996+0000", 2024-09-12T21:51:00.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9699999999999995e-07 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594065+0000", 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8682000000000004e-05 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594073+0000", 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8210000000000002e-06 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594077+0000", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2230000000000001e-06 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594119+0000", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1504000000000001e-05 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594243+0000", 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124828 2024-09-12T21:51:00.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.594373+0000", 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129913 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:6418 5.8 5:15953bdb:::benchmark_data_smithi053_32461_object6417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.591085+0000", 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0032645090000000001, 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034190510000000002, 2024-09-12T21:51:00.611 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 6418 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591085+0000", 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591085+0000", 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591086+0000", 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591162+0000", 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6111000000000004e-05 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591169+0000", 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.793e-06 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591173+0000", 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4700000000000004e-06 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591388+0000", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021452900000000001 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591525+0000", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137293 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.591726+0000", 2024-09-12T21:51:00.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020127 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.592565+0000", 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00083871800000000002 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:6421 5.4 5:229602cc:::benchmark_data_smithi053_32461_object6420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.593184+0000", 2024-09-12T21:51:00.616 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001166201, 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013627120000000001, 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 6421 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593184+0000", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593184+0000", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593184+0000", 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593376+0000", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019151500000000001 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593387+0000", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0794e-05 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593394+0000", 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0809999999999996e-06 2024-09-12T21:51:00.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593473+0000", 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9707000000000001e-05 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593608+0000", 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134537 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:00.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.593791+0000", 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018343 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 5 2024-09-12T21:51:00.621 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:00.622 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:00.646 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:00.645+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:00.748 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:00.746+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:00.815 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:00.815 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:51:00.815 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-09-12T21:51:00.815 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-09-12T21:51:00.816 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:00.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:00.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-12T21:51:00.872 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:00.871+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:00.950 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:00.948+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8211, 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.31a52421", 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8210", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8210", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958595+0000", 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8213, 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.a04d7db1", 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8212", 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8212", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958676+0000", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8214, 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.9f6bf897", 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8213", 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8213", 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958685+0000", 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8215, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.ce6217d2", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8214", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8214", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958688+0000", 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8217, 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.7c9a44e1", 2024-09-12T21:51:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8216", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8216", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958705+0000", 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8219, 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.11b9dfa1", 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8218", 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8218", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.693587s", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0029999380000000002, 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.960160+0000", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8221, 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.47d77267", 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8220", 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8220", 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.694587s", 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0019999589999999999, 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.960593+0000", 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8225, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.6e9bb93f", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8224", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8224", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.696587s", 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.962493+0000", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8226, 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.950d3741", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8225", 2024-09-12T21:51:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8225", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.696587s", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0, 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.962562+0000", 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8206, 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.8d421883", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8205", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8205", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.691587s", 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0049998969999999997, 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958313+0000", 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8209, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.c43dc653", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8208", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8208", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958542+0000", 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8212, 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.135a370a", 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8211", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8211", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958661+0000", 2024-09-12T21:51:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8220, 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.6e92bf63", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8219", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8219", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.693587s", 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0029999380000000002, 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.960196+0000", 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8208, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.7bd9d740", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8207", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8207", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.692587s", 2024-09-12T21:51:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0039999179999999999, 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.958501+0000", 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8218, 2024-09-12T21:51:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.330da334", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8217", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8217", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.693587s", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0029999380000000002, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.959940+0000", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 8224, 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "pg": "5.dce3bebe", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "object_id": "benchmark_data_smithi053_32461_object8223", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "object_locator": "@5", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_id": "benchmark_data_smithi053_32461_object8223", 2024-09-12T21:51:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "target_object_locator": "@5", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "paused": 0, 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "used_replica": 0, 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "precalc_pgid": 0, 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "last_sent": "466.694587s", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0019999589999999999, 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "attempts": 1, 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "snapid": "head", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_context": "0=[]", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-12T21:51:00.961172+0000", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ops": [ 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T21:51:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "write 0~65536 in=65536b" 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ops": [], 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ops": [], 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_stat_ops": [], 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_ops": [], 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "command_ops": [] 2024-09-12T21:51:00.991 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:51:00.993 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 8211, "pg": "5.31a52421", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8210", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8210", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958595+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8213, "pg": "5.a04d7db1", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8212", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8212", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958676+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8214, "pg": "5.9f6bf897", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8213", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8213", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958685+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8215, "pg": "5.ce6217d2", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8214", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8214", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958688+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8217, "pg": "5.7c9a44e1", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8216", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8216", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958705+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8219, "pg": "5.11b9dfa1", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8218", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8218", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.693587s", "age": 0.0029999380000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.960160+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8221, "pg": "5.47d77267", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8220", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8220", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.694587s", "age": 0.0019999589999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.960593+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8225, "pg": "5.6e9bb93f", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8224", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8224", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.696587s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.962493+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8226, "pg": "5.950d3741", "osd": 0, "object_id": "benchmark_data_smithi053_32461_object8225", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8225", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.696587s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.962562+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8206, "pg": "5.8d421883", "osd": 1, "object_id": "benchmark_data_smithi053_32461_object8205", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8205", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.691587s", "age": 0.0049998969999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958313+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8209, "pg": "5.c43dc653", "osd": 1, "object_id": "benchmark_data_smithi053_32461_object8208", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8208", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958542+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8212, "pg": "5.135a370a", "osd": 1, "object_id": "benchmark_data_smithi053_32461_object8211", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8211", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958661+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8220, "pg": "5.6e92bf63", "osd": 1, "object_id": "benchmark_data_smithi053_32461_object8219", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8219", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.693587s", "age": 0.0029999380000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.960196+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8208, "pg": "5.7bd9d740", "osd": 2, "object_id": "benchmark_data_smithi053_32461_object8207", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8207", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.692587s", "age": 0.0039999179999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.958501+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8218, "pg": "5.330da334", "osd": 2, "object_id": "benchmark_data_smithi053_32461_object8217", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8217", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.693587s", "age": 0.0029999380000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.959940+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8224, "pg": "5.dce3bebe", "osd": 2, "object_id": "benchmark_data_smithi053_32461_object8223", "object_locator": "@5", "target_object_id": "benchmark_data_smithi053_32461_object8223", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "466.694587s", "age": 0.0019999589999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T21:51:00.961172+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-12T21:51:00.994 DEBUG:teuthology.orchestra.run.smithi053:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T21:51:00.994 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.115184875000001, 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089271869999999996, 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848606+0000", 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:00.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848615+0000", 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0620000000000007e-06 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848623+0000", 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9920000000000007e-06 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848634+0000", 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1099e-05 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848644+0000", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0182e-05 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848700+0000", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6530000000000003e-05 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848847+0000", 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000146491 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848996+0000", 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148947 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851803+0000", 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028072689999999998 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857449+0000", 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056455899999999998 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857495+0000", 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6581e-05 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857533+0000", 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7444000000000003e-05 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.115124479999999, 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009915063, 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848667+0000", 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4e-07 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848671+0000", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.755e-06 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848678+0000", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.289e-06 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848684+0000", 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.789e-06 2024-09-12T21:51:01.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849321+0000", 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063725800000000003 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849421+0000", 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010059 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849567+0000", 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014592699999999999 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853432+0000", 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003864648 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858460+0000", 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050281609999999997 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858537+0000", 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7253e-05 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858581+0000", 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3553000000000001e-05 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.115087404000001, 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085681980000000008, 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848703+0000", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848704+0000", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6899999999999997e-07 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848711+0000", 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3780000000000003e-06 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848729+0000", 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7711999999999999e-05 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848735+0000", 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6630000000000004e-06 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849316+0000", 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058050799999999998 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849449+0000", 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013346000000000001 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849567+0000", 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118083 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853424+0000", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038564519999999998 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857133+0000", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003708842 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857189+0000", 2024-09-12T21:51:01.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6548000000000001e-05 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857271+0000", 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1983000000000004e-05 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:01.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.115044778000001, 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009824536, 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7499999999999999e-07 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848750+0000", 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3100000000000001e-06 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848758+0000", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.106e-06 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848763+0000", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2129999999999999e-06 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850769+0000", 2024-09-12T21:51:01.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020063220000000001 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850849+0000", 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9589e-05 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850999+0000", 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150214 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.854768+0000", 2024-09-12T21:51:01.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037683769999999998 2024-09-12T21:51:01.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858485+0000", 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037178250000000001 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858529+0000", 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4088999999999997e-05 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858570+0000", 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0716000000000001e-05 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.021 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.115012396000001, 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079339300000000005, 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848778+0000", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848779+0000", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848782+0000", 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6490000000000001e-06 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848789+0000", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8399999999999997e-06 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848797+0000", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3719999999999999e-06 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848850+0000", 2024-09-12T21:51:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3826999999999998e-05 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848969+0000", 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118789 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849091+0000", 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012203 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851284+0000", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021923160000000001 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856617+0000", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053338480000000004 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856672+0000", 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4969999999999997e-05 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856712+0000", 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9650999999999997e-05 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.114974448000002, 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080347249999999995, 2024-09-12T21:51:01.027 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848816+0000", 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848817+0000", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0299999999999999e-07 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848821+0000", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1620000000000001e-06 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848835+0000", 2024-09-12T21:51:01.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3896e-05 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848841+0000", 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6590000000000001e-06 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849417+0000", 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057565199999999996 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849515+0000", 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7572999999999996e-05 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849696+0000", 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181528 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.854931+0000", 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052347330000000001 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856765+0000", 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018337379999999999 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856812+0000", 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7061999999999998e-05 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.856851+0000", 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9119000000000003e-05 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.033 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.11493527, 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009863017, 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848856+0000", 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9999999999999998e-07 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848858+0000", 2024-09-12T21:51:01.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.633e-06 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848872+0000", 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3548e-05 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848877+0000", 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6420000000000004e-06 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850811+0000", 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019336780000000001 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850962+0000", 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001507 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851230+0000", 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026819799999999998 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857851+0000", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006621226 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858635+0000", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00078337199999999995 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858682+0000", 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6984999999999998e-05 2024-09-12T21:51:01.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858718+0000", 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6634999999999997e-05 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.114905633999999, 2024-09-12T21:51:01.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081207889999999998, 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848885+0000", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848895+0000", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.713e-06 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848900+0000", 2024-09-12T21:51:01.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1549999999999998e-06 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848904+0000", 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.388e-06 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848944+0000", 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0172000000000001e-05 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849026+0000", 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2612000000000001e-05 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857006+0000", 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079791889999999994 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.114878609000002, 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081901600000000001, 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848912+0000", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4899999999999995e-07 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848915+0000", 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4820000000000001e-06 2024-09-12T21:51:01.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848921+0000", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4779999999999996e-06 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848928+0000", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.99e-06 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848975+0000", 2024-09-12T21:51:01.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6208999999999998e-05 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849056+0000", 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1049000000000003e-05 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857102+0000", 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080464030000000006 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1383 5.4 5:297de6ae:::benchmark_data_smithi053_32461_object1382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.645795+0000", 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3179956640000001, 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085686210000000002, 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1383 2024-09-12T21:51:01.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645795+0000", 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645795+0000", 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645795+0000", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645910+0000", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011500199999999999 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645916+0000", 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8100000000000003e-06 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645920+0000", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1880000000000004e-06 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.645979+0000", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8792000000000002e-05 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646082+0000", 2024-09-12T21:51:01.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010285699999999999 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646210+0000", 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012779999999999999 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647305+0000", 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001095536 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654271+0000", 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069661020000000001 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654326+0000", 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4066e-05 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654363+0000", 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7877999999999999e-05 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1385 5.e 5:758af996:::benchmark_data_smithi053_32461_object1384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.646204+0000", 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.317586779, 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082518350000000008, 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1385 2024-09-12T21:51:01.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646204+0000", 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646204+0000", 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646204+0000", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4000000000000001e-07 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646308+0000", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103157 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646315+0000", 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7190000000000001e-06 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646320+0000", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3309999999999997e-06 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646520+0000", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020000000000000001 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646591+0000", 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1558999999999997e-05 2024-09-12T21:51:01.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646666+0000", 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4789000000000005e-05 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648059+0000", 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013926419999999999 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654319+0000", 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062606199999999997 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654370+0000", 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1257000000000001e-05 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654456+0000", 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5020999999999998e-05 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.060 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1386 5.e 5:7e90fd89:::benchmark_data_smithi053_32461_object1385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.646487+0000", 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3173033059999999, 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080517169999999999, 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.061 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1386 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646487+0000", 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646487+0000", 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646531+0000", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3395e-05 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646570+0000", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9799000000000003e-05 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646579+0000", 2024-09-12T21:51:01.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4800000000000001e-06 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646585+0000", 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.674e-06 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647036+0000", 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000450865 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647150+0000", 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113835 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647277+0000", 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126506 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648429+0000", 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011523480000000001 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654465+0000", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060355469999999996 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654506+0000", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1190999999999999e-05 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654539+0000", 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3077000000000002e-05 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1388 5.b 5:daaeeb0c:::benchmark_data_smithi053_32461_object1387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.646774+0000", 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3170163480000001, 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080826040000000002, 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1388 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646774+0000", 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646774+0000", 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646775+0000", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8999999999999995e-07 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646879+0000", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010444499999999999 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646888+0000", 2024-09-12T21:51:01.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6670000000000002e-06 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646895+0000", 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.323e-06 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.646934+0000", 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8405999999999998e-05 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647018+0000", 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4452999999999999e-05 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.647092+0000", 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4029000000000006e-05 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648381+0000", 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001288977 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654770+0000", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063892469999999998 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654815+0000", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4492e-05 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654857+0000", 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1774999999999999e-05 2024-09-12T21:51:01.072 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1397 5.b 5:de557ef5:::benchmark_data_smithi053_32461_object1396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.648634+0000", 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3151562349999999, 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085139299999999994, 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.073 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1397 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648634+0000", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648634+0000", 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648635+0000", 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1200000000000001e-07 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648694+0000", 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8653000000000002e-05 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648704+0000", 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0428000000000001e-05 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648709+0000", 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189999999999996e-06 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648743+0000", 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4068e-05 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648817+0000", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3792000000000001e-05 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648920+0000", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010309199999999999 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649618+0000", 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069726499999999997 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657044+0000", 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074260460000000004 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657108+0000", 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4843000000000002e-05 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657148+0000", 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9712000000000002e-05 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1398 5.0 5:0dde7117:::benchmark_data_smithi053_32461_object1397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.648760+0000", 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3150309170000001, 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083954579999999997, 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1398 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648760+0000", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648760+0000", 2024-09-12T21:51:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648760+0000", 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648843+0000", 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3268000000000003e-05 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648849+0000", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.49e-06 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648853+0000", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1740000000000002e-06 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648901+0000", 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7596999999999998e-05 2024-09-12T21:51:01.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649029+0000", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128608 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649178+0000", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000149197 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.650108+0000", 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00092915800000000002 2024-09-12T21:51:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657075+0000", 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069672270000000003 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657119+0000", 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3928999999999999e-05 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657155+0000", 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6309000000000001e-05 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1400 5.8 5:1ae00333:::benchmark_data_smithi053_32461_object1399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.648880+0000", 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3149100460000001, 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083688579999999999, 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.086 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1400 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648880+0000", 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648880+0000", 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648881+0000", 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3799999999999997e-07 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648977+0000", 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6434999999999994e-05 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648983+0000", 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4349999999999996e-06 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.648986+0000", 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.596e-06 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649023+0000", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6628999999999998e-05 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649128+0000", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104688 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649269+0000", 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014154700000000001 2024-09-12T21:51:01.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.651815+0000", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002546211 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657164+0000", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053480919999999996 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657216+0000", 2024-09-12T21:51:01.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2416000000000001e-05 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.657249+0000", 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3271e-05 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:1402 5.b 5:d42e1962:::benchmark_data_smithi053_32461_object1401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.649585+0000", 2024-09-12T21:51:01.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3142051370000001, 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084972599999999995, 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1402 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649585+0000", 2024-09-12T21:51:01.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649585+0000", 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649586+0000", 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8199999999999998e-07 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649681+0000", 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5190000000000002e-05 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649690+0000", 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4090000000000003e-06 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649695+0000", 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9130000000000002e-06 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649727+0000", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1888999999999999e-05 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649800+0000", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3226999999999995e-05 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.649887+0000", 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6774999999999995e-05 2024-09-12T21:51:01.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.654292+0000", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044057139999999998 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.658007+0000", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037151110000000001 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.658040+0000", 2024-09-12T21:51:01.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3031999999999998e-05 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.658083+0000", 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2117999999999999e-05 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:3126 5.4 5:25901752:::benchmark_data_smithi053_32461_object3125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.969223+0000", 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.99456777500000004, 2024-09-12T21:51:01.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089683160000000005, 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 3126 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969223+0000", 2024-09-12T21:51:01.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969223+0000", 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969223+0000", 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7300000000000002e-07 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969346+0000", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012281 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969354+0000", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0569999999999993e-06 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969360+0000", 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9739999999999999e-06 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969394+0000", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3673000000000001e-05 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969472+0000", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8053999999999995e-05 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969560+0000", 2024-09-12T21:51:01.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8492999999999995e-05 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.970494+0000", 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093377800000000002 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978078+0000", 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075845799999999996 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978155+0000", 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6959999999999995e-05 2024-09-12T21:51:01.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978191+0000", 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5564e-05 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:3127 5.4 5:248d44ab:::benchmark_data_smithi053_32461_object3126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:59.969373+0000", 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.994417573, 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089397049999999992, 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 3127 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.106 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969373+0000", 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969373+0000", 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969373+0000", 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969426+0000", 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2370000000000002e-05 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969434+0000", 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0220000000000004e-06 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969440+0000", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1469999999999998e-06 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.969907+0000", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046659099999999998 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.970030+0000", 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012339499999999999 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.970163+0000", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013284500000000001 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.970762+0000", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00059897100000000001 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978239+0000", 2024-09-12T21:51:01.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074773490000000003 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978287+0000", 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8133999999999997e-05 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:59.978313+0000", 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5293e-05 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:7861 5.e 5:70788cd8:::benchmark_data_smithi053_32461_object7860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:00.872902+0000", 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.090888265999999995, 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087737200000000005, 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 7861 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872902+0000", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872902+0000", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872903+0000", 2024-09-12T21:51:01.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872937+0000", 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4625000000000001e-05 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872945+0000", 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:01.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.872952+0000", 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1940000000000003e-06 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.874225+0000", 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001273225 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.874329+0000", 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010380800000000001 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.874405+0000", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5860999999999998e-05 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.874961+0000", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00055619999999999997 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.881621+0000", 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066601849999999999 2024-09-12T21:51:01.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.881652+0000", 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0791999999999999e-05 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:00.881676+0000", 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4216e-05 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:01.117 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:01.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:01.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:01.120 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:01.119+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:01.162 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-12T21:51:01.218 DEBUG:teuthology.parallel:result is None 2024-09-12T21:51:01.219 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-12T21:51:01.229 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-12T21:51:01.229 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-12T21:51:01.230 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:01.229+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:01.254 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:01.254 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:01.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:01.274 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:01.291 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:01.291 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:01.330 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:01.329+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:01.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 2 16 10031 10015 312.945 303.312 0.00369974 0.00319037 2024-09-12T21:51:01.410 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:01.411 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:01.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:01.431 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:01.430+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:01.531 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:01.530+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:01.561 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:01.561 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:01.572 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:01.632 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:01.631+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:01.717 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:01.717 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:01.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:01.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:01.731+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:01.833 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:01.832+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:01.878 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:01.879 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:01.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:01.934 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:01.933+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:02.035 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.034+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.037 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.037 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.047 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:02.136 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.135+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.184 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.185 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:02.236 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.235+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:51:02.333 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.333 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.337 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.336+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:02.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 3 16 13863 13847 288.457 239.5 0.00383483 0.00346143 2024-09-12T21:51:02.438 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.437+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.489 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.489 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:02.544 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:02.543+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:02.640 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.640 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.641 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.639+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:02.702 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T21:51:02.702 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T21:51:02.703 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T21:51:02.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T21:51:02.741 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:02.740+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:02.832 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:02.832 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:02.842 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:02.840+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:02.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:02.943 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:02.942+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 24, 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "fsid": "26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "created": "2024-09-12T21:50:18.608077+0000", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "modified": "2024-09-12T21:51:00.248864+0000", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "last_up_change": "2024-09-12T21:50:28.694982+0000", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "last_in_change": "2024-09-12T21:50:19.412280+0000", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T21:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_num": 5806080, 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_set": [ 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "nodeep-scrub", 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "noscrub", 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "pglog_hardlimit", 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "purged_snapdirs", 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_deletes", 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "sortbitwise" 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_version": 4, 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T21:51:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_snapshot": "", 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_max": 5, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd": 3, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "require_min_compat_client": "luminous", 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "min_compat_client": "jewel", 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "require_osd_release": "squid", 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_crimson": false, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "pools": [ 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 1, 2024-09-12T21:51:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": ".mgr", 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:28.897797+0000", 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:51:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 1, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 1, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 1, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 1, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 1, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:51:03.020 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "11", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:51:03.021 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:51:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:51:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_max": 32, 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 1 2024-09-12T21:51:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": {} 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 2.9900000095367432, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 2.9900000095367432, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 2, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 2, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:51:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 2, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "rbd", 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:33.626302+0000", 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 8193, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:51:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 8, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 8, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 8, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 8, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 8, 2024-09-12T21:51:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "15", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:51:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 2, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 15, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:51:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:51:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd": {} 2024-09-12T21:51:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.5, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.5, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.5, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.5, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 3, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "cephfs_metadata", 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:37.711817+0000", 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:51:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:51:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "18", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:51:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:51:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:51:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_bias": 4, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 16, 2024-09-12T21:51:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_priority": 5 2024-09-12T21:51:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:51:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs": { 2024-09-12T21:51:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": "cephfs" 2024-09-12T21:51:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:51:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:51:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.1299999952316284, 2024-09-12T21:51:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.1299999952316284, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:51:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:51:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 4, 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "cephfs_data", 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:38.173173+0000", 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:51:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:51:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 64, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 64, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 64, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 64, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 64, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:51:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "19", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:51:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:51:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:51:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 64, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs": { 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "data": "cephfs" 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.1299999952316284, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.1299999952316284, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 5, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "unique_pool_0", 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-09-12T21:50:57.006804+0000", 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-09-12T21:51:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "is_stretch_pool": false, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 16, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 16, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 16, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 16, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 16, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-09-12T21:51:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "23", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-09-12T21:51:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-09-12T21:51:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-09-12T21:51:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "rados": {} 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.1299999952316284, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.1299999952316284, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-09-12T21:51:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "osds": [ 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "4d630dcc-ee37-4038-813b-4830ab592c6c", 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:51:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:51:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:51:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:51:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:51:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 21, 2024-09-12T21:51:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:51:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:51:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:51:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6800", 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6801", 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6802", 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6803", 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:51:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6806", 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6807", 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6804", 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.89:6805", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2197885711 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.89:6801/2197885711", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.89:6803/2197885711", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.89:6807/2197885711", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.89:6805/2197885711", 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:51:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "671f6920-54e5-4839-ad7e-ca44ff87ceb9", 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:51:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 21, 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6800", 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6801", 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6802", 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6803", 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6806", 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6807", 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:51:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6804", 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.120:6805", 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2538027148 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.120:6801/2538027148", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.120:6803/2538027148", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.120:6807/2538027148", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.120:6805/2538027148", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "e46b482a-7d0d-48a5-a625-9f8a31045bf3", 2024-09-12T21:51:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 8, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 21, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6800", 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6801", 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-09-12T21:51:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6802", 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6803", 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6806", 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6807", 2024-09-12T21:51:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6804", 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-12T21:51:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.172:6805", 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1685972058 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.172:6801/1685972058", 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.172:6803/1685972058", 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.172:6807/1685972058", 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.172:6805/1685972058", 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-09-12T21:51:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_xinfo": [ 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:51:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.056106+0000", 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.592376+0000", 2024-09-12T21:51:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-09-12T21:50:26.835978+0000", 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap": [], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_items": [], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_primaries": [], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_temp": [], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_temp": [], 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklist": {}, 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "range_blocklist": {}, 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profiles": { 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "default": { 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-failure-domain": "osd", 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "k": "2", 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "m": "1", 2024-09-12T21:51:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin": "jerasure", 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "technique": "reed_sol_van" 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps_queue": [], 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "new_removed_snaps": [], 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "new_purged_snaps": [], 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_node_flags": {}, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "device_class_flags": {}, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode": { 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_enabled": false, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_bucket_count": 0, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "degraded_stretch_mode": 0, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "recovering_stretch_mode": 0, 2024-09-12T21:51:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_bucket": 0 2024-09-12T21:51:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-12T21:51:03.084 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:51:03.085 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:03.086 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:03.086 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': '26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6', 'created': '2024-09-12T21:50:18.608077+0000', 'modified': '2024-09-12T21:51:00.248864+0000', 'last_up_change': '2024-09-12T21:50:28.694982+0000', 'last_in_change': '2024-09-12T21:50:19.412280+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T21:50:28.897797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T21:50:33.626302+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T21:50:37.711817+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T21:50:38.173173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T21:50:57.006804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4d630dcc-ee37-4038-813b-4830ab592c6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6800', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6801', 'nonce': 2197885711}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 2197885711}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6806', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6807', 'nonce': 2197885711}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6804', 'nonce': 2197885711}, {'type': 'v1', 'addr': '172.21.15.89:6805', 'nonce': 2197885711}]}, 'public_addr': '172.21.15.89:6801/2197885711', 'cluster_addr': '172.21.15.89:6803/2197885711', 'heartbeat_back_addr': '172.21.15.89:6807/2197885711', 'heartbeat_front_addr': '172.21.15.89:6805/2197885711', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '671f6920-54e5-4839-ad7e-ca44ff87ceb9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 2538027148}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 2538027148}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 2538027148}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 2538027148}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 2538027148}]}, 'public_addr': '172.21.15.120:6801/2538027148', 'cluster_addr': '172.21.15.120:6803/2538027148', 'heartbeat_back_addr': '172.21.15.120:6807/2538027148', 'heartbeat_front_addr': '172.21.15.120:6805/2538027148', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e46b482a-7d0d-48a5-a625-9f8a31045bf3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6800', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6801', 'nonce': 1685972058}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6802', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6803', 'nonce': 1685972058}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6806', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6807', 'nonce': 1685972058}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6804', 'nonce': 1685972058}, {'type': 'v1', 'addr': '172.21.15.172:6805', 'nonce': 1685972058}]}, 'public_addr': '172.21.15.172:6801/1685972058', 'cluster_addr': '172.21.15.172:6803/1685972058', 'heartbeat_back_addr': '172.21.15.172:6807/1685972058', 'heartbeat_front_addr': '172.21.15.172:6805/1685972058', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.056106+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.592376+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T21:50:26.835978+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T21:51:03.086 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T21:51:03.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:03.087 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:03.084+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:03.186 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:03.184+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:03.234 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:03.234 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:03.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:51:03.291 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:03.290+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:03.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:03.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 4 16 17550 17534 273.947 230.438 0.00496265 0.0036452 2024-09-12T21:51:03.387 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:03.386+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:03.395 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:03.396 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:03.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:03.438 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:03.457 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:03.475 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:03.475 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:03.495 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:03.494+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:03.589 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:03.588+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.750105831999999, 2024-09-12T21:51:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081578469999999993, 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848210+0000", 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848215+0000", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7260000000000002e-06 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848226+0000", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1192000000000001e-05 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848240+0000", 2024-09-12T21:51:03.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4191e-05 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848253+0000", 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2529e-05 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848580+0000", 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000327855 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848723+0000", 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014282300000000001 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848931+0000", 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020801000000000001 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851890+0000", 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029591679999999999 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856045+0000", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041549500000000001 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856324+0000", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027864200000000001 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856368+0000", 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3761000000000003e-05 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.750034131, 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088897950000000007, 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848282+0000", 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4399999999999999e-07 2024-09-12T21:51:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848288+0000", 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848297+0000", 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7820000000000005e-06 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848305+0000", 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5510000000000002e-06 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849672+0000", 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013672809999999999 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849781+0000", 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108804 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849953+0000", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172146 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852364+0000", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024108469999999998 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857078+0000", 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047140289999999998 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857134+0000", 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.622e-05 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857171+0000", 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7138999999999998e-05 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.750000875000001, 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275378, 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2600000000000002e-07 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848319+0000", 2024-09-12T21:51:03.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8349999999999997e-06 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848327+0000", 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.515e-06 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848333+0000", 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1140000000000002e-06 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849652+0000", 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013191279999999999 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849852+0000", 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019977499999999999 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:03.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.850544+0000", 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069252699999999996 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852835+0000", 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002291066 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858497+0000", 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056611939999999996 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858556+0000", 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9769000000000003e-05 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858590+0000", 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3929e-05 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749907518000001, 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010318723, 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848408+0000", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848412+0000", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9430000000000002e-06 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848420+0000", 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5299999999999999e-06 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848432+0000", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2034e-05 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848442+0000", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0146000000000001e-05 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851061+0000", 2024-09-12T21:51:03.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002619148 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851127+0000", 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6292999999999997e-05 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851221+0000", 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3215999999999997e-05 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852900+0000", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001679301 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858673+0000", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005772732 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858706+0000", 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3055000000000001e-05 2024-09-12T21:51:03.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858727+0000", 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1325e-05 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749859637, 2024-09-12T21:51:03.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088434919999999997, 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848456+0000", 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848457+0000", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-07 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848462+0000", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848469+0000", 2024-09-12T21:51:03.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3849999999999996e-06 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848483+0000", 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3973e-05 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851408+0000", 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029247980000000002 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851478+0000", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9609000000000004e-05 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851566+0000", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8492999999999995e-05 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852975+0000", 2024-09-12T21:51:03.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001409291 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857213+0000", 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042380200000000003 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857264+0000", 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0946000000000003e-05 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857300+0000", 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5271000000000002e-05 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749820653, 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084995899999999996, 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848495+0000", 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848496+0000", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848502+0000", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6729999999999997e-06 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848509+0000", 2024-09-12T21:51:03.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.148e-06 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848515+0000", 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5660000000000003e-06 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848635+0000", 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001197 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848765+0000", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027000000000001 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848927+0000", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161402 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851255+0000", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002328653 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856931+0000", 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056754249999999996 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856964+0000", 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3800000000000002e-05 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.856995+0000", 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0258999999999999e-05 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749782849999999, 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085654359999999992, 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:03.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848533+0000", 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848534+0000", 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3200000000000005e-07 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848537+0000", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848548+0000", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0044000000000001e-05 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848555+0000", 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849607+0000", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010520379999999999 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849729+0000", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012258200000000001 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857098+0000", 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073691379999999999 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749730988, 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088320069999999994, 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848585+0000", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848586+0000", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4780000000000001e-06 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848591+0000", 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848627+0000", 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5617000000000001e-05 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848646+0000", 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8958999999999999e-05 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.851908+0000", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032625140000000002 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.852028+0000", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119589 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.857417+0000", 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053888210000000002 2024-09-12T21:51:03.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.749651186000001, 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099012079999999999, 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848665+0000", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848668+0000", 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8e-06 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848679+0000", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936e-05 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848691+0000", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1807999999999999e-05 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.848698+0000", 2024-09-12T21:51:03.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9059999999999996e-06 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849038+0000", 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000339527 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.849171+0000", 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013372899999999999 2024-09-12T21:51:03.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:39.858566+0000", 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093945020000000008 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:594 5.a 5:519c981a:::benchmark_data_smithi053_32461_object593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1097914229999999, 2024-09-12T21:51:03.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081029229999999997, 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 594 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:03.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488524+0000", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488525+0000", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488660+0000", 2024-09-12T21:51:03.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013510599999999999 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488680+0000", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9768000000000001e-05 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488688+0000", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5190000000000003e-06 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488730+0000", 2024-09-12T21:51:03.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2122000000000001e-05 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488845+0000", 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115812 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.488975+0000", 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012919299999999999 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.492876+0000", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039010780000000001 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496577+0000", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037008499999999999 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496606+0000", 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8897000000000001e-05 2024-09-12T21:51:03.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.496627+0000", 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1798e-05 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:761 5.5 5:ac487c3c:::benchmark_data_smithi053_32461_object760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0712586709999998, 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070621049999999999, 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 761 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527057+0000", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527058+0000", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2900000000000003e-07 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527117+0000", 2024-09-12T21:51:03.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8894000000000002e-05 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527125+0000", 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4479999999999994e-06 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527132+0000", 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527749+0000", 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00061702700000000003 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.527910+0000", 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016116700000000001 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.528044+0000", 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013416 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.528740+0000", 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069650500000000004 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534068+0000", 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053279019999999998 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534099+0000", 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0352999999999999e-05 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.534119+0000", 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0602e-05 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:883 5.a 5:57814417:::benchmark_data_smithi053_32461_object882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0459565609999997, 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007478452, 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 883 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552359+0000", 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552360+0000", 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552419+0000", 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9039999999999997e-05 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552426+0000", 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9909999999999996e-06 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552430+0000", 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2119999999999997e-06 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552480+0000", 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9509000000000003e-05 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552595+0000", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011496499999999999 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.552728+0000", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013377800000000001 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.556484+0000", 2024-09-12T21:51:03.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037559350000000002 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559748+0000", 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032636570000000001 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559798+0000", 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0269000000000003e-05 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.559838+0000", 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9515999999999999e-05 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:1391 5.a 5:5eab0a78:::benchmark_data_smithi053_32461_object1390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.9513969119999999, 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076745870000000001, 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646919+0000", 2024-09-12T21:51:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.646920+0000", 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7400000000000002e-07 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647025+0000", 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104975 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647033+0000", 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647041+0000", 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1100000000000003e-06 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647091+0000", 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9650000000000001e-05 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647230+0000", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013927899999999999 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.647366+0000", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013627600000000001 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.648521+0000", 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011550600000000001 2024-09-12T21:51:03.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654539+0000", 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060172610000000003 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654570+0000", 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1333e-05 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.654593+0000", 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3567999999999999e-05 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3126 5.4 e23/21 5:25901752:::benchmark_data_smithi053_32461_object3125:head v 23'180, mlcod=23'178)", 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.628683224, 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078331400000000006, 2024-09-12T21:51:03.673 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969633+0000", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-07 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969880+0000", 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024677 2024-09-12T21:51:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969888+0000", 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2630000000000003e-06 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969895+0000", 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3860000000000004e-06 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969938+0000", 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3095e-05 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.969960+0000", 2024-09-12T21:51:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2192999999999999e-05 2024-09-12T21:51:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977423+0000", 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074631740000000004 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977466+0000", 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2656e-05 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3127 5.4 e23/21 5:248d44ab:::benchmark_data_smithi053_32461_object3126:head v 23'181, mlcod=23'178)", 2024-09-12T21:51:03.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6279893059999999, 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007182323, 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970326+0000", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970327+0000", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-07 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970352+0000", 2024-09-12T21:51:03.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5729e-05 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970357+0000", 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7679999999999999e-06 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970360+0000", 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8210000000000002e-06 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970390+0000", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-05 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.970401+0000", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1003e-05 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977469+0000", 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070674819999999999 2024-09-12T21:51:03.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:50:59.977509+0000", 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9861999999999999e-05 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:3289 5.2 e23/21 5:47917739:::benchmark_data_smithi053_32461_object3288:head v 23'217, mlcod=23'214)", 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5973950439999998, 2024-09-12T21:51:03.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075174889999999996, 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:03.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.000921+0000", 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4000000000000002e-07 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001015+0000", 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4188e-05 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001024+0000", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7199999999999995e-06 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001031+0000", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4300000000000003e-06 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001088+0000", 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7067000000000001e-05 2024-09-12T21:51:03.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.001123+0000", 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.008406+0000", 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072824389999999999 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.008438+0000", 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2435999999999999e-05 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:7774 5.6 5:65c74f2f:::benchmark_data_smithi053_32461_object7773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:00.852713+0000", 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.745602683, 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070514130000000003, 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7774 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852713+0000", 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852713+0000", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852714+0000", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6499999999999998e-07 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852890+0000", 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017560199999999999 2024-09-12T21:51:03.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852899+0000", 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7210000000000006e-06 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852906+0000", 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8929999999999999e-06 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.852945+0000", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8399999999999998e-05 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.853025+0000", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0365999999999996e-05 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.853111+0000", 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5939000000000005e-05 2024-09-12T21:51:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.855494+0000", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023827739999999998 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.859717+0000", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042231020000000003 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.859743+0000", 2024-09-12T21:51:03.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6383000000000001e-05 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.859765+0000", 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1367999999999999e-05 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:7870 5.3 5:c0c2b0c5:::benchmark_data_smithi053_32461_object7869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:03.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:00.874827+0000", 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.7234889959999999, 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071702629999999996, 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7870 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.874827+0000", 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.874827+0000", 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.874828+0000", 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-07 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.874987+0000", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000159247 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.874996+0000", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.875002+0000", 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:03.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.875069+0000", 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7002000000000007e-05 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.875158+0000", 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8675000000000001e-05 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.875271+0000", 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011338 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.877446+0000", 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021751689999999998 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.881907+0000", 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044609669999999997 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.881954+0000", 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6377e-05 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:00.881997+0000", 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3284000000000001e-05 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:9241 5.6 5:6a352ef1:::benchmark_data_smithi053_32461_object9240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:01.180891+0000", 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.417425272, 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078338550000000007, 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 9241 2024-09-12T21:51:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.180891+0000", 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.180891+0000", 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.180892+0000", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8599999999999996e-07 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181015+0000", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012390799999999999 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181027+0000", 2024-09-12T21:51:03.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1749000000000001e-05 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181036+0000", 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2150000000000007e-06 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.182152+0000", 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011152740000000001 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.182263+0000", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111246 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.182403+0000", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140288 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.184233+0000", 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001829752 2024-09-12T21:51:03.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188650+0000", 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004416723 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188690+0000", 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0584000000000003e-05 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188724+0000", 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.413e-05 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:9242 5.6 5:6e08db1b:::benchmark_data_smithi053_32461_object9241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:01.181055+0000", 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.4172609650000001, 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077479230000000003, 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:03.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 9242 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181055+0000", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181055+0000", 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181056+0000", 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.68e-07 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181120+0000", 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4739000000000005e-05 2024-09-12T21:51:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181128+0000", 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1689999999999992e-06 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.181140+0000", 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:03.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.182864+0000", 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017237610000000001 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.182964+0000", 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9976999999999995e-05 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.183062+0000", 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8201000000000004e-05 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.184252+0000", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011904789999999999 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188732+0000", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044795149999999999 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188771+0000", 2024-09-12T21:51:03.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9192e-05 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:01.188803+0000", 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1599e-05 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:03.716 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:03.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:03.718 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:03.716+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:03.818 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:03.817+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19350 5.0 5:010063b5:::benchmark_data_smithi053_32461_object19349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.853609+0000", 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045507409999999996, 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045698589999999999, 2024-09-12T21:51:03.859 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19350 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853609+0000", 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853609+0000", 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853610+0000", 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9699999999999995e-07 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853663+0000", 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3878000000000002e-05 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853671+0000", 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9719999999999992e-06 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853676+0000", 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3409999999999996e-06 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854553+0000", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087695899999999996 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854730+0000", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000177806 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854870+0000", 2024-09-12T21:51:03.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013964700000000001 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.856740+0000", 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018694440000000001 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19356 5.b 5:dc87f614:::benchmark_data_smithi053_32461_object19355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.864 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.854162+0000", 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039976270000000001, 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040663899999999996, 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19356 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854162+0000", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854162+0000", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854162+0000", 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:51:03.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854228+0000", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5685000000000006e-05 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854235+0000", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7429999999999996e-06 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854239+0000", 2024-09-12T21:51:03.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4039999999999997e-06 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854277+0000", 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7413000000000002e-05 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854386+0000", 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109368 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854509+0000", 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000123337 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855695+0000", 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011856550000000001 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19357 5.e 5:79ff8788:::benchmark_data_smithi053_32461_object19356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.869 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.854677+0000", 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034819650000000001, 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035934180000000001, 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19357 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854677+0000", 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854677+0000", 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.854678+0000", 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7700000000000003e-07 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855254+0000", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057569399999999997 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855263+0000", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8109999999999992e-06 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855270+0000", 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8090000000000004e-06 2024-09-12T21:51:03.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855314+0000", 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4812999999999999e-05 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855430+0000", 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115686 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855567+0000", 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137148 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857026+0000", 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014591809999999999 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19360 5.8 5:192bccb5:::benchmark_data_smithi053_32461_object19359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.874 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.857295+0000", 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00086434100000000002, 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010198220000000001, 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19360 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857295+0000", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857295+0000", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857296+0000", 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5400000000000001e-07 2024-09-12T21:51:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857381+0000", 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5178000000000003e-05 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857387+0000", 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6289999999999998e-06 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857391+0000", 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.33e-06 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857423+0000", 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1618000000000001e-05 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857517+0000", 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4775e-05 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.857634+0000", 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011629900000000001 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.879 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19345 5.e 5:7f009023:::benchmark_data_smithi053_32461_object19344:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.853195+0000", 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049641219999999996, 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051661490000000001, 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19345 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853195+0000", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853195+0000", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853196+0000", 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8400000000000004e-07 2024-09-12T21:51:03.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853284+0000", 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8428000000000001e-05 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853301+0000", 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6069000000000001e-05 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853308+0000", 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2250000000000003e-06 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853443+0000", 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013555699999999999 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853574+0000", 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013031699999999999 2024-09-12T21:51:03.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853701+0000", 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012701800000000001 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855255+0000", 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015539429999999999 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19347 5.0 5:0a7aa344:::benchmark_data_smithi053_32461_object19346:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.853323+0000", 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048360679999999998, 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050796160000000003, 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19347 2024-09-12T21:51:03.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853323+0000", 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853323+0000", 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853324+0000", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5899999999999996e-07 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853375+0000", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0782999999999998e-05 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853382+0000", 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2230000000000001e-06 2024-09-12T21:51:03.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853389+0000", 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7710000000000001e-06 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853445+0000", 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6570000000000002e-05 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:03.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853592+0000", 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000146928 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.853703+0000", 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011106400000000001 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.855644+0000", 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019405329999999999 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.889 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:03.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:03.890 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-09-12T21:51:03.890 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-09-12T21:51:03.890 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:03.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:03.919 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:03.918+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:04.020 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:04.019+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:04.069 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:04.069 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:51:04.069 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-09-12T21:51:04.069 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-09-12T21:51:04.069 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:04.080 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:04.121 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:04.120+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:04.222 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:04.221+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.407352155000002, 2024-09-12T21:51:04.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009915063, 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848666+0000", 2024-09-12T21:51:04.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848667+0000", 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4e-07 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848671+0000", 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.755e-06 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848678+0000", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.289e-06 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848684+0000", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.789e-06 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849321+0000", 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063725800000000003 2024-09-12T21:51:04.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849421+0000", 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010059 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.849567+0000", 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014592699999999999 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.853432+0000", 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003864648 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858460+0000", 2024-09-12T21:51:04.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050281609999999997 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858537+0000", 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7253e-05 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858581+0000", 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3553000000000001e-05 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.265 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.407272453000001, 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009824536, 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848746+0000", 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7499999999999999e-07 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848750+0000", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3100000000000001e-06 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848758+0000", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.106e-06 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848763+0000", 2024-09-12T21:51:04.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2129999999999999e-06 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850769+0000", 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020063220000000001 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850849+0000", 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9589e-05 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850999+0000", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150214 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.854768+0000", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037683769999999998 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858485+0000", 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037178250000000001 2024-09-12T21:51:04.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858529+0000", 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4088999999999997e-05 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858570+0000", 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0716000000000001e-05 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.407162945, 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009863017, 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848855+0000", 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848856+0000", 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9999999999999998e-07 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848858+0000", 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.633e-06 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848872+0000", 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3548e-05 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.848877+0000", 2024-09-12T21:51:04.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6420000000000004e-06 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850811+0000", 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019336780000000001 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.850962+0000", 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0001507 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.851230+0000", 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026819799999999998 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.857851+0000", 2024-09-12T21:51:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006621226 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858635+0000", 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00078337199999999995 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858682+0000", 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6984999999999998e-05 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:50:39.858718+0000", 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6634999999999997e-05 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18279 5.4 5:2e09be94:::benchmark_data_smithi053_32461_object18278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.557097+0000", 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69892126399999999, 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098240419999999998, 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18279 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557097+0000", 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557097+0000", 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557098+0000", 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557193+0000", 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5820000000000001e-05 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557203+0000", 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6989999999999998e-06 2024-09-12T21:51:04.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557210+0000", 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.187e-06 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557246+0000", 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5233e-05 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557331+0000", 2024-09-12T21:51:04.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5113999999999999e-05 2024-09-12T21:51:04.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.557411+0000", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0779999999999996e-05 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.558530+0000", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011183949999999999 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566825+0000", 2024-09-12T21:51:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082949900000000003 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566883+0000", 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8252999999999999e-05 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566921+0000", 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7815000000000003e-05 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18284 5.4 5:24115849:::benchmark_data_smithi053_32461_object18283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.560771+0000", 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69524730300000004, 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010990414, 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18284 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560771+0000", 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560771+0000", 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560772+0000", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560825+0000", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3004000000000003e-05 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560833+0000", 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2239999999999995e-06 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560847+0000", 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4017e-05 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560884+0000", 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7462999999999997e-05 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560959+0000", 2024-09-12T21:51:04.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4257000000000004e-05 2024-09-12T21:51:04.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561033+0000", 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4554999999999993e-05 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561902+0000", 2024-09-12T21:51:04.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00086935099999999998 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571672+0000", 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009769158 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571723+0000", 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1447999999999999e-05 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571761+0000", 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8182000000000001e-05 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18286 5.8 5:172abec6:::benchmark_data_smithi053_32461_object18285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.560926+0000", 2024-09-12T21:51:04.293 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69509194200000002, 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010800852, 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18286 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560926+0000", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560926+0000", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560927+0000", 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8500000000000001e-07 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560954+0000", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7512e-05 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560963+0000", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2519999999999999e-06 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560968+0000", 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7960000000000001e-06 2024-09-12T21:51:04.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560997+0000", 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8575e-05 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561100+0000", 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102896 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561183+0000", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3325999999999995e-05 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562785+0000", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016018510000000001 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571660+0000", 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088751420000000008 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571691+0000", 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1015e-05 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571727+0000", 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5902000000000003e-05 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18287 5.8 5:1c3b6e88:::benchmark_data_smithi053_32461_object18286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.560979+0000", 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69503870700000003, 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010838135, 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18287 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560979+0000", 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560979+0000", 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.560980+0000", 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9200000000000001e-07 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561029+0000", 2024-09-12T21:51:04.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9169000000000003e-05 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561037+0000", 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6009999999999997e-06 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561043+0000", 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2099999999999998e-06 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561887+0000", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084455700000000001 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562005+0000", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117283 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562143+0000", 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013783600000000001 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.563474+0000", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013312689999999999 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571759+0000", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082854529999999999 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571791+0000", 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1406999999999999e-05 2024-09-12T21:51:04.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571818+0000", 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6857999999999999e-05 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18291 5.8 5:1cf58a7d:::benchmark_data_smithi053_32461_object18290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.561774+0000", 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69424387499999995, 2024-09-12T21:51:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010232110000000001, 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18291 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561774+0000", 2024-09-12T21:51:04.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561774+0000", 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561775+0000", 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1500000000000003e-07 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561833+0000", 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561856+0000", 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3207e-05 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.561871+0000", 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4514e-05 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562808+0000", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00093773999999999995 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562893+0000", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4606999999999998e-05 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.562971+0000", 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8578999999999994e-05 2024-09-12T21:51:04.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.565241+0000", 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022693589999999999 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571962+0000", 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067211119999999996 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.571989+0000", 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7039e-05 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.572006+0000", 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7422999999999999e-05 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.312 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:18302 5.d 5:bf8bfef3:::benchmark_data_smithi053_32461_object18301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.566920+0000", 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.68909854999999998, 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010627757999999999, 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 18302 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566920+0000", 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566920+0000", 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566920+0000", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5299999999999999e-07 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566946+0000", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5816000000000002e-05 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566951+0000", 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1710000000000001e-06 2024-09-12T21:51:04.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566955+0000", 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.301e-06 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.566994+0000", 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9048000000000003e-05 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.567110+0000", 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116067 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.567272+0000", 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161263 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.568678+0000", 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001406043 2024-09-12T21:51:04.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.577482+0000", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088043740000000002 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.577516+0000", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3816000000000003e-05 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.577547+0000", 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1405999999999997e-05 2024-09-12T21:51:04.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19286 5.8 5:1e1311d6:::benchmark_data_smithi053_32461_object19285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:03.836487+0000", 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.41953133300000001, 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01031441, 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.319 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19286 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836487+0000", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836487+0000", 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836487+0000", 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3600000000000004e-07 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836518+0000", 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0982000000000003e-05 2024-09-12T21:51:04.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836526+0000", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3470000000000001e-06 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.836532+0000", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4139999999999999e-06 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.842327+0000", 2024-09-12T21:51:04.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057949129999999996 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.842471+0000", 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143616 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.842607+0000", 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013636900000000001 2024-09-12T21:51:04.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.843857+0000", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001249542 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.846708+0000", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028512870000000001 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.846759+0000", 2024-09-12T21:51:04.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:03.846801+0000", 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1820000000000003e-05 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19936 5.e 5:7e19e945:::benchmark_data_smithi053_32461_object19935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.018851+0000", 2024-09-12T21:51:04.325 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.23716679199999999, 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096595550000000002, 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.326 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19936 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018851+0000", 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018851+0000", 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018852+0000", 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0900000000000001e-07 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018889+0000", 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7391999999999997e-05 2024-09-12T21:51:04.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018899+0000", 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6160000000000008e-06 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.018921+0000", 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1722999999999999e-05 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.021056+0000", 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021356489999999999 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.021145+0000", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9067999999999995e-05 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.021266+0000", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012047799999999999 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.022531+0000", 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012650929999999999 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.028447+0000", 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059161250000000004 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.028476+0000", 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9102999999999999e-05 2024-09-12T21:51:04.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.028511+0000", 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4699000000000001e-05 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19974 5.0 5:0d9a8d11:::benchmark_data_smithi053_32461_object19973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.031887+0000", 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.224131364, 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010266288, 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19974 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.334 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031887+0000", 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031887+0000", 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031887+0000", 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031936+0000", 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8306000000000001e-05 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031944+0000", 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7250000000000003e-06 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.031951+0000", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3180000000000003e-06 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.034160+0000", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022092449999999999 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.034299+0000", 2024-09-12T21:51:04.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013883100000000001 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.034443+0000", 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014432599999999999 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.035954+0000", 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001510705 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042062+0000", 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061085999999999996 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042113+0000", 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0932e-05 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042153+0000", 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9635999999999998e-05 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:19977 5.0 5:0d51e11f:::benchmark_data_smithi053_32461_object19976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.032029+0000", 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.22398958699999999, 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010205982000000001, 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.340 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 19977 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032029+0000", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032029+0000", 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032029+0000", 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2e-07 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032057+0000", 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7449000000000001e-05 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032063+0000", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9709999999999998e-06 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.032077+0000", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3988999999999999e-05 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.035168+0000", 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030907220000000002 2024-09-12T21:51:04.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.035249+0000", 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0479e-05 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.035330+0000", 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1644000000000006e-05 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.040530+0000", 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005199258 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042161+0000", 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016312270000000001 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042202+0000", 2024-09-12T21:51:04.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0831999999999998e-05 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.042235+0000", 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2891000000000001e-05 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20098 5.b 5:d7284278:::benchmark_data_smithi053_32461_object20097:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.346 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.071019+0000", 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.18499896399999999, 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098910349999999994, 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20098 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071019+0000", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071019+0000", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071021+0000", 2024-09-12T21:51:04.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4580000000000001e-06 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071140+0000", 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119599 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071147+0000", 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1609999999999997e-06 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071153+0000", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2190000000000003e-06 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071196+0000", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3786999999999999e-05 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071332+0000", 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013536000000000001 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.071478+0000", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000146718 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.072936+0000", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001457514 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.080817+0000", 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078813709999999999 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.080873+0000", 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5186000000000003e-05 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.080910+0000", 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7662e-05 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20208 5.4 5:2f4ed13f:::benchmark_data_smithi053_32461_object20207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.106231+0000", 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.14978745500000001, 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010116389, 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20208 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106231+0000", 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106231+0000", 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106231+0000", 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4700000000000002e-07 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106337+0000", 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105522 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106342+0000", 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7690000000000002e-06 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.106346+0000", 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8419999999999998e-06 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.107108+0000", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00076172000000000002 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.107238+0000", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013002399999999999 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.107372+0000", 2024-09-12T21:51:04.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013388199999999999 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.108370+0000", 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00099766599999999992 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.116277+0000", 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079074990000000001 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.116310+0000", 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3022000000000003e-05 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.116347+0000", 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6996000000000003e-05 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20375 5.8 5:1951433d:::benchmark_data_smithi053_32461_object20374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.161266+0000", 2024-09-12T21:51:04.359 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.094752273999999997, 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010414789000000001, 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20375 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161266+0000", 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161266+0000", 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161266+0000", 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3099999999999998e-07 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161290+0000", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3434e-05 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161296+0000", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0569999999999998e-06 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.161299+0000", 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.241e-06 2024-09-12T21:51:04.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.162196+0000", 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00089732799999999997 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.162346+0000", 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014969699999999999 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.162491+0000", 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014490799999999999 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.163766+0000", 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001274961 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.171579+0000", 2024-09-12T21:51:04.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078127950000000009 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.171630+0000", 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0923e-05 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.171681+0000", 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0914000000000001e-05 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.365 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20475 5.e 5:78379e1a:::benchmark_data_smithi053_32461_object20474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.191002+0000", 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.065016455000000001, 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010853552000000001, 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.366 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20475 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191002+0000", 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191002+0000", 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191002+0000", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.23e-07 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191145+0000", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000142299 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191154+0000", 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7920000000000004e-06 2024-09-12T21:51:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191161+0000", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7070000000000003e-06 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191207+0000", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5772999999999997e-05 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191416+0000", 2024-09-12T21:51:04.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020887 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191620+0000", 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000204265 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.195049+0000", 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003429072 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201735+0000", 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066863110000000003 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201787+0000", 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1867000000000003e-05 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201855+0000", 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7873000000000006e-05 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20478 5.4 5:2164b6da:::benchmark_data_smithi053_32461_object20477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.191268+0000", 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.064749741, 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010533793, 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.372 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20478 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191268+0000", 2024-09-12T21:51:04.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191268+0000", 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191269+0000", 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7000000000000003e-07 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191386+0000", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011696099999999999 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191394+0000", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9789999999999993e-06 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191400+0000", 2024-09-12T21:51:04.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9229999999999999e-06 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191770+0000", 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00036986000000000001 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191882+0000", 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111532 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.192038+0000", 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015618500000000001 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.195442+0000", 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034044930000000002 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201720+0000", 2024-09-12T21:51:04.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062774459999999999 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201763+0000", 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3339e-05 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.201802+0000", 2024-09-12T21:51:04.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9104999999999999e-05 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20479 5.b 5:ddfaa09c:::benchmark_data_smithi053_32461_object20478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.191413+0000", 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.064604660999999994, 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010707872, 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20479 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191413+0000", 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191413+0000", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191414+0000", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.06e-07 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191440+0000", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6336e-05 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191447+0000", 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.737e-06 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191452+0000", 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0000000000000004e-06 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191509+0000", 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7253999999999998e-05 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191623+0000", 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113112 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191743+0000", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120901 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.195458+0000", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037149549999999998 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202022+0000", 2024-09-12T21:51:04.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0065634389999999999 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202080+0000", 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8152999999999997e-05 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202121+0000", 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1378999999999998e-05 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.386 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:20480 5.b 5:d3bbb363:::benchmark_data_smithi053_32461_object20479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.191628+0000", 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.064390292000000002, 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010615319999999999, 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:04.387 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 20480 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191628+0000", 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191628+0000", 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191629+0000", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191654+0000", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5473000000000002e-05 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191669+0000", 2024-09-12T21:51:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5055000000000001e-05 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.191677+0000", 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3479999999999998e-06 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.192645+0000", 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00096882100000000003 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.192749+0000", 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104035 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.192898+0000", 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000149118 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:04.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.195480+0000", 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025818600000000001 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202161+0000", 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066807100000000003 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202208+0000", 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7394000000000001e-05 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:04.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.202243+0000", 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4703999999999998e-05 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:04.394 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:04.395 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 5 16 21026 21010 262.603 217.25 0.00397456 0.00380435 2024-09-12T21:51:04.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:04.397 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:04.394+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:04.496 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:04.495+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:04.541 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21657 5.2 5:40b2360a:::benchmark_data_smithi053_32461_object21656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.539534+0000", 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00090693999999999996, 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00094287600000000004, 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.542 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21657 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539534+0000", 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539534+0000", 2024-09-12T21:51:04.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539534+0000", 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3e-07 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539588+0000", 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3353000000000002e-05 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539595+0000", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0570000000000004e-06 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539599+0000", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8700000000000002e-06 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539637+0000", 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7762000000000002e-05 2024-09-12T21:51:04.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539756+0000", 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119325 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.539889+0000", 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000132791 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:21659 5.3 e25/21 5:cc17397c:::benchmark_data_smithi053_32461_object21658:head v 25'1415, mlcod=25'1412)", 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.540383+0000", 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.7376000000000001e-05, 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000269552, 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540383+0000", 2024-09-12T21:51:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540383+0000", 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540384+0000", 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6700000000000003e-07 2024-09-12T21:51:04.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540420+0000", 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5528999999999998e-05 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540433+0000", 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3616e-05 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540440+0000", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3849999999999999e-06 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540473+0000", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3473999999999998e-05 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540485+0000", 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1635e-05 2024-09-12T21:51:04.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:21663 5.d e25/21 5:bab77db1:::benchmark_data_smithi053_32461_object21662:head v 25'1389, mlcod=25'1387)", 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.540490+0000", 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999514, 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023352099999999999, 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540490+0000", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540490+0000", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540490+0000", 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9500000000000002e-07 2024-09-12T21:51:04.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540585+0000", 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4474000000000004e-05 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540596+0000", 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0915e-05 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540603+0000", 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.559e-06 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540646+0000", 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2957999999999998e-05 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540668+0000", 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1991999999999999e-05 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:21660 5.c e25/21 5:3c3714c1:::benchmark_data_smithi053_32461_object21659:head v 25'1249, mlcod=25'1247)", 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.540516+0000", 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999242, 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000268096, 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540516+0000", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540516+0000", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540517+0000", 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:04.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540618+0000", 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100902 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540627+0000", 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4350000000000003e-06 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540633+0000", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.037e-06 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540678+0000", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4579000000000001e-05 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540696+0000", 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8227999999999999e-05 2024-09-12T21:51:04.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:21661 5.5 e25/21 5:ac9de7c6:::benchmark_data_smithi053_32461_object21660:head v 25'1375, mlcod=25'1372)", 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.540647+0000", 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9997935, 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000191526, 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540647+0000", 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540647+0000", 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540648+0000", 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6300000000000001e-07 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540681+0000", 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3222000000000001e-05 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540688+0000", 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0310000000000001e-06 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540693+0000", 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3240000000000002e-06 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540726+0000", 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2755000000000001e-05 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.540738+0000", 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.171e-05 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21649 5.2 5:4fe47b37:::benchmark_data_smithi053_32461_object21648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.534521+0000", 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0059193750000000002, 2024-09-12T21:51:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063755679999999999, 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21649 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534521+0000", 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534521+0000", 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534522+0000", 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534634+0000", 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011241799999999999 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534640+0000", 2024-09-12T21:51:04.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9880000000000001e-06 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534645+0000", 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4719999999999997e-06 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534691+0000", 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5804999999999999e-05 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534868+0000", 2024-09-12T21:51:04.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017770899999999999 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534995+0000", 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126797 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.537630+0000", 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026346619999999999 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21652 5.1 5:8c62c194:::benchmark_data_smithi053_32461_object21651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.534813+0000", 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0056275530000000004, 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061586940000000001, 2024-09-12T21:51:04.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21652 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534813+0000", 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534813+0000", 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534814+0000", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534862+0000", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8701e-05 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534869+0000", 2024-09-12T21:51:04.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9759999999999998e-06 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534875+0000", 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7810000000000002e-06 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.534923+0000", 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7392999999999998e-05 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.535044+0000", 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012167699999999999 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.535176+0000", 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131729 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.537606+0000", 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024297199999999998 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 7 2024-09-12T21:51:04.578 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:04.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:04.597 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:04.596+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:04.697 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:04.696+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:04.714 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:04.714 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:04.714 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:04.714 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:04.714 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:04.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:04.799 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:04.797+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.017077378, 2024-09-12T21:51:04.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01083307, 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848169+0000", 2024-09-12T21:51:04.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848170+0000", 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9999999999999996e-07 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848181+0000", 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.099e-05 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848189+0000", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0569999999999993e-06 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848196+0000", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9700000000000002e-06 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851110+0000", 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029139919999999998 2024-09-12T21:51:04.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851270+0000", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000159734 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851394+0000", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012404699999999999 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857752+0000", 2024-09-12T21:51:04.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006358084 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858944+0000", 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001192303 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.858978+0000", 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4144999999999999e-05 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859002+0000", 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3947999999999998e-05 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.016931245999999, 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011134068, 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.874 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848315+0000", 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848316+0000", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2900000000000002e-07 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848321+0000", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9509999999999997e-06 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848330+0000", 2024-09-12T21:51:04.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5259999999999993e-06 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848339+0000", 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0450000000000006e-06 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.851994+0000", 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036549239999999999 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.852274+0000", 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027998600000000003 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.852419+0000", 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014527799999999999 2024-09-12T21:51:04.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857776+0000", 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005356675 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859391+0000", 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016153300000000001 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859422+0000", 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1602e-05 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859449+0000", 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6821999999999998e-05 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.880 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.016894745999998, 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011189774, 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848352+0000", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848356+0000", 2024-09-12T21:51:04.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3299999999999999e-06 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848371+0000", 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.501e-05 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848419+0000", 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8204000000000001e-05 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.853929+0000", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005509931 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.854057+0000", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000128388 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.854258+0000", 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020107299999999999 2024-09-12T21:51:04.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857780+0000", 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003522234 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859486+0000", 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001705856 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859516+0000", 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9249000000000001e-05 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859542+0000", 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5998000000000001e-05 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.016808270999999, 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011182694, 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848438+0000", 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848439+0000", 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848453+0000", 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4175999999999999e-05 2024-09-12T21:51:04.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848460+0000", 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2620000000000001e-06 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848468+0000", 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5549999999999997e-06 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855111+0000", 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066429990000000001 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855224+0000", 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011350599999999999 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.855354+0000", 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000129598 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857786+0000", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024317010000000001 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859569+0000", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001783736 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859600+0000", 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0341999999999999e-05 2024-09-12T21:51:04.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859621+0000", 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1084999999999999e-05 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.016768300999999, 2024-09-12T21:51:04.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011223219, 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848478+0000", 2024-09-12T21:51:04.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848479+0000", 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848483+0000", 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6370000000000001e-06 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848490+0000", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9519999999999994e-06 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848498+0000", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1319999999999996e-06 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856289+0000", 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0077910210000000004 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856454+0000", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000165184 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856547+0000", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3060999999999996e-05 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857794+0000", 2024-09-12T21:51:04.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001246877 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859649+0000", 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018552449999999999 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859679+0000", 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9784000000000001e-05 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859701+0000", 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2636000000000001e-05 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.016741228000001, 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014234999, 2024-09-12T21:51:04.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848506+0000", 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848508+0000", 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.334e-06 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848513+0000", 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6990000000000002e-06 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848516+0000", 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6349999999999999e-06 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856735+0000", 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082186740000000005 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856800+0000", 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5495999999999998e-05 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856936+0000", 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013602300000000001 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859761+0000", 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028247319999999999 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862641+0000", 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028799590000000001 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862699+0000", 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7525999999999998e-05 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862740+0000", 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1545000000000003e-05 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.015265875000001, 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01277415, 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:04.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849982+0000", 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849986+0000", 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7110000000000003e-06 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849998+0000", 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1647e-05 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850005+0000", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1559999999999998e-06 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856859+0000", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068537160000000001 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857053+0000", 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019449800000000001 2024-09-12T21:51:04.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862755+0000", 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057013819999999996 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18259 5.2 5:4460e580:::benchmark_data_smithi053_32461_object18258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:04.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.320305327, 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015716200999999999, 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18259 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544942+0000", 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544996+0000", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3995000000000001e-05 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545001+0000", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545005+0000", 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.546e-06 2024-09-12T21:51:04.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545379+0000", 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00037468100000000003 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545480+0000", 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101196 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545561+0000", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0630000000000006e-05 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.547246+0000", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001685211 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560600+0000", 2024-09-12T21:51:04.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013353535 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560633+0000", 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2703000000000002e-05 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560657+0000", 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4814999999999999e-05 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.917 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18289 5.1 5:889fa756:::benchmark_data_smithi053_32461_object18288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.561065+0000", 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.3041813499999999, 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010646522, 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.918 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18289 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561065+0000", 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561065+0000", 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561066+0000", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1500000000000005e-07 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561110+0000", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4224999999999998e-05 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561118+0000", 2024-09-12T21:51:04.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0199999999999994e-06 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561123+0000", 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4739999999999996e-06 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561159+0000", 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.591e-05 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561246+0000", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6602999999999997e-05 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561370+0000", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012393899999999999 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.563222+0000", 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018518810000000001 2024-09-12T21:51:04.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571657+0000", 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084348489999999995 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571688+0000", 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1934000000000003e-05 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571712+0000", 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3172000000000001e-05 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18290 5.7 5:ee02c3ac:::benchmark_data_smithi053_32461_object18289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.561162+0000", 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.3040840330000001, 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010593783000000001, 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.924 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18290 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561162+0000", 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561162+0000", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561163+0000", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2099999999999996e-07 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561238+0000", 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4796999999999996e-05 2024-09-12T21:51:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561246+0000", 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3270000000000001e-06 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561252+0000", 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9399999999999999e-06 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561300+0000", 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7904000000000001e-05 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561416+0000", 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001154 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.561557+0000", 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014131300000000001 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.563228+0000", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016716179999999999 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571700+0000", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084715429999999998 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571732+0000", 2024-09-12T21:51:04.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2113000000000002e-05 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.571756+0000", 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4107000000000001e-05 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:20147 5.f 5:fcc59e5d:::benchmark_data_smithi053_32461_object20146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.087719+0000", 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.77752728199999999, 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010753352000000001, 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20147 2024-09-12T21:51:04.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087719+0000", 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087719+0000", 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087720+0000", 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5499999999999998e-07 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087779+0000", 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8723e-05 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087786+0000", 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1149999999999996e-06 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087790+0000", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0810000000000004e-06 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087830+0000", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0252e-05 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087909+0000", 2024-09-12T21:51:04.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9121000000000004e-05 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.087999+0000", 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9559000000000001e-05 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.089426+0000", 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001427659 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.098357+0000", 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0089304239999999993 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.098449+0000", 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2657000000000004e-05 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.098473+0000", 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3105999999999999e-05 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.936 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:20993 5.f 5:f9aadced:::benchmark_data_smithi053_32461_object20992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.341557+0000", 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.52368943800000001, 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010815181, 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 20993 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341557+0000", 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341557+0000", 2024-09-12T21:51:04.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341558+0000", 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3099999999999997e-07 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341624+0000", 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6416999999999998e-05 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341633+0000", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5580000000000001e-06 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.341639+0000", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.207e-06 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.343189+0000", 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015497779999999999 2024-09-12T21:51:04.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.343304+0000", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011570600000000001 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.343436+0000", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131309 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.346474+0000", 2024-09-12T21:51:04.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003038565 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.352281+0000", 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058065909999999998 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.352332+0000", 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1029999999999998e-05 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.352372+0000", 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0289e-05 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21125 5.1 5:861c7106:::benchmark_data_smithi053_32461_object21124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.489128428, 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012474285999999999, 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.943 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21125 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376119+0000", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9999999999999998e-07 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376152+0000", 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3300999999999998e-05 2024-09-12T21:51:04.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376159+0000", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6340000000000001e-06 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376166+0000", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3389999999999998e-06 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376205+0000", 2024-09-12T21:51:04.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9444999999999999e-05 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376338+0000", 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013308300000000001 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376471+0000", 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013258000000000001 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378804+0000", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023333339999999998 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388501+0000", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096972159999999998 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388552+0000", 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0237e-05 2024-09-12T21:51:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388592+0000", 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0617000000000001e-05 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21126 5.2 5:43240305:::benchmark_data_smithi053_32461_object21125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48906984999999997, 2024-09-12T21:51:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012465611, 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21126 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9800000000000003e-07 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376221+0000", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4070999999999999e-05 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376231+0000", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2450000000000004e-06 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376238+0000", 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6320000000000008e-06 2024-09-12T21:51:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376437+0000", 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019865400000000001 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376552+0000", 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011482899999999999 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376661+0000", 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109731 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378394+0000", 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001732403 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388569+0000", 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010174706 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388606+0000", 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7181000000000002e-05 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388642+0000", 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6560999999999998e-05 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21128 5.7 5:ec5be353:::benchmark_data_smithi053_32461_object21127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48847633800000001, 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011816129999999999, 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21128 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376771+0000", 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.61e-07 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376842+0000", 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1549000000000002e-05 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376856+0000", 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3359e-05 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376863+0000", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376927+0000", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4362999999999993e-05 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377046+0000", 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118186 2024-09-12T21:51:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000123168 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378868+0000", 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016988470000000001 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388520+0000", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096524079999999995 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388552+0000", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2360999999999997e-05 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388586+0000", 2024-09-12T21:51:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3969e-05 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21129 5.2 5:4616ce26:::benchmark_data_smithi053_32461_object21128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48832614000000002, 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011844387, 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21129 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376921+0000", 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376991+0000", 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9970999999999998e-05 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376999+0000", 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4300000000000006e-06 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377006+0000", 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2689999999999996e-06 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377473+0000", 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00046779800000000001 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377593+0000", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011927 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377760+0000", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000167076 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378677+0000", 2024-09-12T21:51:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00091693899999999997 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388679+0000", 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010002494000000001 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388731+0000", 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1526000000000001e-05 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388765+0000", 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3971999999999999e-05 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21130 5.7 5:eb8fb8f5:::benchmark_data_smithi053_32461_object21129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.488077076, 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011511643, 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21130 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377170+0000", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7100000000000001e-07 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377194+0000", 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3515000000000001e-05 2024-09-12T21:51:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377203+0000", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2480000000000002e-06 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377209+0000", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2620000000000004e-06 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377904+0000", 2024-09-12T21:51:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00069497799999999996 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378019+0000", 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011523099999999999 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378148+0000", 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012899999999999999 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379148+0000", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00099980500000000009 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388621+0000", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094731280000000008 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388662+0000", 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0283e-05 2024-09-12T21:51:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388681+0000", 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9422000000000001e-05 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21133 5.1 5:8aa8d599:::benchmark_data_smithi053_32461_object21132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.377571+0000", 2024-09-12T21:51:04.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48767541199999997, 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011107361, 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21133 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377571+0000", 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377571+0000", 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377572+0000", 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5300000000000003e-07 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377692+0000", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120454 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377702+0000", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8709999999999992e-06 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377710+0000", 2024-09-12T21:51:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0069999999999997e-06 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377753+0000", 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2460999999999999e-05 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377890+0000", 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013768999999999999 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378008+0000", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011786300000000001 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379134+0000", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001126068 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388621+0000", 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094864739999999999 2024-09-12T21:51:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388648+0000", 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7160000000000001e-05 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388678+0000", 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0559999999999999e-05 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21140 5.2 5:450185a2:::benchmark_data_smithi053_32461_object21139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48547110700000001, 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011781809000000001, 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21140 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379776+0000", 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.02e-06 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379837+0000", 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0143000000000003e-05 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379846+0000", 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9830000000000002e-06 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379850+0000", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000001e-06 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379882+0000", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1699000000000003e-05 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379956+0000", 2024-09-12T21:51:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4450999999999996e-05 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.380034+0000", 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7274000000000006e-05 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.380780+0000", 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00074669700000000005 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391500+0000", 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010720057999999999 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391532+0000", 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1180999999999998e-05 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391557+0000", 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5533000000000001e-05 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21303 5.2 5:415cb324:::benchmark_data_smithi053_32461_object21302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.432371+0000", 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.43287568999999998, 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011225604, 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21303 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432371+0000", 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432371+0000", 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432371+0000", 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432491+0000", 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119694 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432499+0000", 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2279999999999998e-06 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.432507+0000", 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3329999999999999e-06 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.434279+0000", 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001772811 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.434462+0000", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018261899999999999 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.434564+0000", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010166300000000001 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.436211+0000", 2024-09-12T21:51:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001647719 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.443539+0000", 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0073278750000000002 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.443571+0000", 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1593000000000001e-05 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.443596+0000", 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5466999999999999e-05 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:04.993 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:04.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:04.995 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:04.993+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:05.095 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.094+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23636 5.0 e25/21 5:0a43c3c6:::benchmark_data_smithi053_32461_object23635:head v 25'1487, mlcod=25'1482)", 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.138923+0000", 2024-09-12T21:51:05.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003717297, 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037340059999999998, 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138923+0000", 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138923+0000", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138923+0000", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000003e-07 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138970+0000", 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6715000000000003e-05 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138978+0000", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2269999999999993e-06 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.138985+0000", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4160000000000001e-06 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139384+0000", 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039965299999999998 2024-09-12T21:51:05.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139405+0000", 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1004000000000001e-05 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23637 5.6 5:6a652a58:::benchmark_data_smithi053_32461_object23636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.139504+0000", 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003135522, 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031924119999999999, 2024-09-12T21:51:05.148 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23637 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139504+0000", 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139504+0000", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139505+0000", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999997e-07 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139564+0000", 2024-09-12T21:51:05.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8511000000000003e-05 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139573+0000", 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4199999999999996e-06 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139580+0000", 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7800000000000003e-06 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139623+0000", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3142999999999997e-05 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139732+0000", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108863 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.139866+0000", 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013397100000000001 2024-09-12T21:51:05.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141934+0000", 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020684829999999999 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23638 5.4 e25/21 5:24c1d82c:::benchmark_data_smithi053_32461_object23637:head v 25'1505, mlcod=25'1502)", 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140027+0000", 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026125839999999998, 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027135250000000001, 2024-09-12T21:51:05.153 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140027+0000", 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140027+0000", 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140028+0000", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140092+0000", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4422000000000001e-05 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140102+0000", 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9729999999999992e-06 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140109+0000", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140152+0000", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3859000000000001e-05 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140168+0000", 2024-09-12T21:51:05.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5948e-05 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23639 5.8 e25/21 5:195980b4:::benchmark_data_smithi053_32461_object23638:head v 25'1502, mlcod=25'1499)", 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140138+0000", 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002501414, 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026590749999999999, 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140138+0000", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140138+0000", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140139+0000", 2024-09-12T21:51:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6699999999999999e-07 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140234+0000", 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4579000000000004e-05 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140242+0000", 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9629999999999998e-06 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140247+0000", 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140312+0000", 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5531999999999995e-05 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140335+0000", 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3230999999999998e-05 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23641 5.3 5:c9c13fad:::benchmark_data_smithi053_32461_object23640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140111+0000", 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002529257, 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027261350000000002, 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23641 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140111+0000", 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140111+0000", 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140111+0000", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000005e-07 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140245+0000", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013381299999999999 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140255+0000", 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9639999999999998e-06 2024-09-12T21:51:05.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140262+0000", 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.725e-06 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140331+0000", 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9486000000000005e-05 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140447+0000", 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115519 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140561+0000", 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113973 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23640 5.b e25/21 5:dd646a12:::benchmark_data_smithi053_32461_object23639:head v 25'1444, mlcod=25'1442)", 2024-09-12T21:51:05.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140261+0000", 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002378912, 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026223280000000002, 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140261+0000", 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140261+0000", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140261+0000", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4700000000000002e-07 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140295+0000", 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3158999999999999e-05 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140301+0000", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140307+0000", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.541e-06 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140415+0000", 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108088 2024-09-12T21:51:05.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140438+0000", 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3011999999999999e-05 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23644 5.6 5:61770153:::benchmark_data_smithi053_32461_object23643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002358967, 2024-09-12T21:51:05.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026343930000000001, 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23644 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140282+0000", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140402+0000", 2024-09-12T21:51:05.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140414+0000", 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140421+0000", 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7100000000000007e-06 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140865+0000", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000443724 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140980+0000", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115148 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141097+0000", 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116876 2024-09-12T21:51:05.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142829+0000", 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017317820000000001 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23648 5.3 5:c607b623:::benchmark_data_smithi053_32461_object23647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140462+0000", 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002178185, 2024-09-12T21:51:05.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025218100000000002, 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23648 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140462+0000", 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140462+0000", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140462+0000", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6199999999999997e-07 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140560+0000", 2024-09-12T21:51:05.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7588000000000001e-05 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140570+0000", 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0052e-05 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140577+0000", 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.934e-06 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141647+0000", 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001069611 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141761+0000", 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114746 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141885+0000", 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123242 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23642 5.2 e25/21 5:43554cba:::benchmark_data_smithi053_32461_object23641:head v 25'1500, mlcod=25'1498)", 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140629+0000", 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020105740000000002, 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023920730000000002, 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140629+0000", 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140629+0000", 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140630+0000", 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140656+0000", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5933000000000001e-05 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140681+0000", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4936e-05 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140688+0000", 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9460000000000001e-06 2024-09-12T21:51:05.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140766+0000", 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8559999999999993e-05 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140789+0000", 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2388e-05 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23643 5.8 e25/21 5:157f1bfc:::benchmark_data_smithi053_32461_object23642:head v 25'1503, mlcod=25'1499)", 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.141180+0000", 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001460226, 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00187156, 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141180+0000", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141180+0000", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141180+0000", 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7800000000000001e-07 2024-09-12T21:51:05.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141220+0000", 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.981e-05 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141231+0000", 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0916e-05 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141238+0000", 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.613e-06 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141279+0000", 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1109999999999998e-05 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141295+0000", 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6612e-05 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23645 5.4 e25/21 5:236e152b:::benchmark_data_smithi053_32461_object23644:head v 25'1506, mlcod=25'1503)", 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.141359+0000", 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012810720000000001, 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001721406, 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141359+0000", 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141359+0000", 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141359+0000", 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141435+0000", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6067000000000002e-05 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141446+0000", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0355e-05 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141452+0000", 2024-09-12T21:51:05.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3879999999999997e-06 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141511+0000", 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9298e-05 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141531+0000", 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9559999999999999e-05 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23649 5.a 5:5090a26d:::benchmark_data_smithi053_32461_object23648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.141419+0000", 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012206020000000001, 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016921499999999999, 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23649 2024-09-12T21:51:05.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141419+0000", 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141419+0000", 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141420+0000", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0699999999999996e-07 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141448+0000", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7838e-05 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141456+0000", 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9519999999999994e-06 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141462+0000", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8640000000000001e-06 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141661+0000", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019913999999999999 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141783+0000", 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162700000000001 2024-09-12T21:51:05.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141908+0000", 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012544800000000001 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23647 5.4 e25/21 5:2487fc7d:::benchmark_data_smithi053_32461_object23646:head v 25'1507, mlcod=25'1503)", 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.142336+0000", 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00030367600000000001, 2024-09-12T21:51:05.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000810912, 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142336+0000", 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142336+0000", 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142337+0000", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2300000000000001e-07 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142389+0000", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1675999999999998e-05 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142397+0000", 2024-09-12T21:51:05.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1589999999999993e-06 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142403+0000", 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2060000000000004e-06 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142454+0000", 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.096e-05 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142473+0000", 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8754999999999999e-05 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23650 5.b e25/21 5:d86544be:::benchmark_data_smithi053_32461_object23649:head v 25'1445, mlcod=25'1442)", 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.142502+0000", 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00013820600000000001, 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067495599999999999, 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:05.199 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142502+0000", 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142502+0000", 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142502+0000", 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2900000000000004e-07 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142559+0000", 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6477999999999997e-05 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142567+0000", 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3790000000000006e-06 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142573+0000", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4999999999999999e-06 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142623+0000", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0523999999999999e-05 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142639+0000", 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6305000000000001e-05 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.203 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:05.203 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-09-12T21:51:05.203 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:05.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:05.205 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.203+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:51:05.305 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:05.305+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:05.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 6 16 24343 24327 253.385 207.312 0.00619395 0.00394336 2024-09-12T21:51:05.387 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:05.387 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:05.387 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:05.387 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:05.387 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:05.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:05.445 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.444+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:05.507 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.506+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:18259 5.2 e25/21 5:4460e580:::benchmark_data_smithi053_32461_object18258:head v 25'1141, mlcod=25'1137)", 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.997579167, 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01482526, 2024-09-12T21:51:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545703+0000", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0760999999999997e-05 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545722+0000", 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8606000000000001e-05 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545728+0000", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.285e-06 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551313+0000", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055852610000000002 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551331+0000", 2024-09-12T21:51:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7547e-05 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560433+0000", 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091016819999999998 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560477+0000", 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4400999999999997e-05 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:18262 5.c 5:3390dac7:::benchmark_data_smithi053_32461_object18261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.9964022539999999, 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014099459, 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 18262 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546830+0000", 2024-09-12T21:51:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8700000000000004e-07 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546893+0000", 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3465000000000003e-05 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546901+0000", 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9019999999999999e-06 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546906+0000", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551185+0000", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042795699999999999 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551290+0000", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010442600000000001 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551438+0000", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014857 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.553548+0000", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002109325 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560619+0000", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070717169999999999 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560882+0000", 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026296799999999998 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560928+0000", 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5627999999999997e-05 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:20533 5.c 5:3e65c558:::benchmark_data_smithi053_32461_object20532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3335877229999999, 2024-09-12T21:51:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012693705, 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 20533 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209644+0000", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209779+0000", 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013489799999999999 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209785+0000", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0079999999999999e-06 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209788+0000", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7720000000000001e-06 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210972+0000", 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001183981 2024-09-12T21:51:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.211050+0000", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7097999999999999e-05 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.211194+0000", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.215777+0000", 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045833580000000001 2024-09-12T21:51:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222219+0000", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064416530000000003 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222291+0000", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1983000000000005e-05 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222337+0000", 2024-09-12T21:51:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6146000000000002e-05 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:20535 5.c 5:3a0aeb35:::benchmark_data_smithi053_32461_object20534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.210172+0000", 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.333058684, 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012270378, 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 20535 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210172+0000", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210172+0000", 2024-09-12T21:51:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210173+0000", 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8000000000000004e-07 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210273+0000", 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9442000000000001e-05 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210283+0000", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.046e-05 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210290+0000", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8539999999999999e-06 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.212844+0000", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025541629999999999 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.212957+0000", 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011331 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.213058+0000", 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100529 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.215837+0000", 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027790950000000001 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222345+0000", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065081449999999999 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222392+0000", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7178999999999997e-05 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222443+0000", 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0321000000000002e-05 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:20629 5.c 5:3d1d33a2:::benchmark_data_smithi053_32461_object20628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.240619+0000", 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3026122689999999, 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011665843, 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 20629 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240619+0000", 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240619+0000", 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240620+0000", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.062e-06 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240673+0000", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3307999999999999e-05 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240683+0000", 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0180000000000001e-05 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.240690+0000", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8900000000000001e-06 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.245523+0000", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048331290000000002 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.245656+0000", 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013305700000000001 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.245802+0000", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145453 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.249128+0000", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033263120000000001 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.252194+0000", 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030661059999999999 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.252242+0000", 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7503999999999998e-05 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.252284+0000", 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2842000000000001e-05 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:21127 5.a 5:5f0bfa8f:::benchmark_data_smithi053_32461_object21126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.376392+0000", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1668392860000001, 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012054568, 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 21127 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376392+0000", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376392+0000", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376393+0000", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.142e-06 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376480+0000", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7373000000000005e-05 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376488+0000", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8720000000000002e-06 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376494+0000", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0090000000000004e-06 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376548+0000", 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4175000000000002e-05 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376664+0000", 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115352 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376772+0000", 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108695 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.378599+0000", 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018267839999999999 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388301+0000", 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097018020000000007 2024-09-12T21:51:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388356+0000", 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5195000000000003e-05 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388446+0000", 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0168999999999997e-05 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:21125 5.1 e25/21 5:861c7106:::benchmark_data_smithi053_32461_object21124:head v 25'1257, mlcod=25'1255)", 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.376605+0000", 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1666258309999999, 2024-09-12T21:51:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011710082, 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376605+0000", 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376605+0000", 2024-09-12T21:51:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376606+0000", 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376667+0000", 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1567000000000002e-05 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376675+0000", 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1359999999999997e-06 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376683+0000", 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2629999999999997e-06 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376750+0000", 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7460999999999997e-05 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376769+0000", 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8757999999999999e-05 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388266+0000", 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011496901 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388315+0000", 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9413999999999998e-05 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:21126 5.2 e25/21 5:43240305:::benchmark_data_smithi053_32461_object21125:head v 25'1331, mlcod=25'1328)", 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.376766+0000", 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1664651020000001, 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011703003999999999, 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376766+0000", 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376766+0000", 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376766+0000", 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8500000000000002e-07 2024-09-12T21:51:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376816+0000", 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9917999999999999e-05 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376824+0000", 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.96e-06 2024-09-12T21:51:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.376830+0000", 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.998e-06 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.377522+0000", 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069170799999999997 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.377533+0000", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0701e-05 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388449+0000", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010916827 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.388469+0000", 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9406999999999999e-05 2024-09-12T21:51:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:21139 5.b e25/21 5:dc3ad759:::benchmark_data_smithi053_32461_object21138:head v 25'1279, mlcod=25'1276)", 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.379473+0000", 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.163757554, 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011783745999999999, 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379473+0000", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379473+0000", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379474+0000", 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6699999999999999e-07 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379529+0000", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5053999999999998e-05 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379537+0000", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0800000000000006e-06 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379541+0000", 2024-09-12T21:51:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4309999999999996e-06 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379573+0000", 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1167999999999997e-05 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.379585+0000", 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2541000000000001e-05 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.391224+0000", 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011638689000000001 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.391257+0000", 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3315999999999997e-05 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:21363 5.5 5:a1ff0b24:::benchmark_data_smithi053_32461_object21362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.451516+0000", 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.091715091, 2024-09-12T21:51:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011698508999999999, 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 21363 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451516+0000", 2024-09-12T21:51:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451516+0000", 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451516+0000", 2024-09-12T21:51:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7100000000000002e-07 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451540+0000", 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3896999999999998e-05 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451547+0000", 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0589999999999997e-06 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.451553+0000", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2510000000000002e-06 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.452284+0000", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073171499999999997 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.452383+0000", 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8407999999999997e-05 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.452463+0000", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0309999999999995e-05 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.453605+0000", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001141839 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.463145+0000", 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095404280000000001 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.463188+0000", 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2814e-05 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.463214+0000", 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6217e-05 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23092 5.5 5:a692fd05:::benchmark_data_smithi053_32461_object23091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.965841+0000", 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.57738989200000002, 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011935484, 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23092 2024-09-12T21:51:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965841+0000", 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965841+0000", 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965842+0000", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.54e-07 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965909+0000", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7584999999999998e-05 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965918+0000", 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6989999999999992e-06 2024-09-12T21:51:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965925+0000", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6649999999999997e-06 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965968+0000", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3044999999999999e-05 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966083+0000", 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115134 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966206+0000", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122609 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.972701+0000", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064950629999999997 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977687+0000", 2024-09-12T21:51:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049867899999999996 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977740+0000", 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2252e-05 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977776+0000", 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6788000000000001e-05 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23088 5.7 e25/21 5:ecfaba2a:::benchmark_data_smithi053_32461_object23087:head v 25'1463, mlcod=25'1461)", 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.965960+0000", 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.577270846, 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011702825, 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965960+0000", 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965960+0000", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.965960+0000", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9000000000000002e-07 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966007+0000", 2024-09-12T21:51:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6581e-05 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966015+0000", 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7810000000000005e-06 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966020+0000", 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3399999999999997e-06 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966073+0000", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2787000000000001e-05 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966091+0000", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7778000000000002e-05 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977638+0000", 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011546967999999999 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977663+0000", 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999999e-05 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:23090 5.4 e25/21 5:2e81616b:::benchmark_data_smithi053_32461_object23089:head v 25'1466, mlcod=25'1463)", 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.966209+0000", 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.57702146600000004, 2024-09-12T21:51:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011490884, 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966209+0000", 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966209+0000", 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966210+0000", 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3900000000000005e-07 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966254+0000", 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4514000000000001e-05 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966262+0000", 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9650000000000008e-06 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966269+0000", 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5579999999999997e-06 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966306+0000", 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7320000000000002e-05 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.966322+0000", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5729000000000001e-05 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977662+0000", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011339619 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.977700+0000", 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8640000000000003e-05 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23644 5.6 5:61770153:::benchmark_data_smithi053_32461_object23643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.40294993600000001, 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014971791, 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23644 2024-09-12T21:51:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140282+0000", 2024-09-12T21:51:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140402+0000", 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140414+0000", 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140421+0000", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7100000000000007e-06 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140865+0000", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000443724 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140980+0000", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115148 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141097+0000", 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116876 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142829+0000", 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017317820000000001 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155134+0000", 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012305015000000001 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155201+0000", 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6802000000000002e-05 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155253+0000", 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2082e-05 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24518 5.3 5:ce09bda5:::benchmark_data_smithi053_32461_object24517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.13868973600000001, 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01429952, 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24518 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404542+0000", 2024-09-12T21:51:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405188+0000", 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064633900000000001 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405198+0000", 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3130000000000004e-06 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405204+0000", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379999999999996e-06 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405248+0000", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.354e-05 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405356+0000", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107532 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405486+0000", 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130109 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409406+0000", 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039201740000000002 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418737+0000", 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093307640000000001 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418802+0000", 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5257000000000002e-05 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418841+0000", 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8824e-05 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24519 5.3 5:ce535336:::benchmark_data_smithi053_32461_object24518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.13801308100000001, 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013759295, 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24519 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405219+0000", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405249+0000", 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405256+0000", 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2320000000000004e-06 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405262+0000", 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7830000000000004e-06 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406483+0000", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012208189999999999 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406574+0000", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1508999999999994e-05 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406659+0000", 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4444999999999995e-05 2024-09-12T21:51:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409429+0000", 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027704940000000001 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418893+0000", 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094641670000000008 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418945+0000", 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1697000000000003e-05 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418977+0000", 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2199000000000001e-05 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24626 5.a 5:50037ab4:::benchmark_data_smithi053_32461_object24625:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.100606591, 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013314127, 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24626 2024-09-12T21:51:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442625+0000", 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442784+0000", 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015933599999999999 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442793+0000", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8429999999999999e-06 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442799+0000", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2179999999999996e-06 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444084+0000", 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012851830000000001 2024-09-12T21:51:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444202+0000", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117689 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444341+0000", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013924400000000001 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.445946+0000", 2024-09-12T21:51:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001604826 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455828+0000", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098820430000000001 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455894+0000", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5258000000000004e-05 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455938+0000", 2024-09-12T21:51:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4904999999999998e-05 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24691 5.6 5:6b1738e8:::benchmark_data_smithi053_32461_object24690:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.466488+0000", 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.076742498000000006, 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011657153999999999, 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24691 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466488+0000", 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466488+0000", 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466490+0000", 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.217e-06 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466602+0000", 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011257200000000001 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466620+0000", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8178000000000001e-05 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466630+0000", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2129999999999997e-06 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.469579+0000", 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029498179999999999 2024-09-12T21:51:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.469690+0000", 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011076199999999999 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.469803+0000", 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112483 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.477622+0000", 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078197470000000002 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478054+0000", 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00043121300000000001 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478101+0000", 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7537999999999998e-05 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478146+0000", 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4413000000000003e-05 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24692 5.6 5:6c4f3583:::benchmark_data_smithi053_32461_object24691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.466649+0000", 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.076581741999999994, 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012045093999999999, 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24692 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466649+0000", 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466649+0000", 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466650+0000", 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000004e-07 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466683+0000", 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3067e-05 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466700+0000", 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7368999999999999e-05 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.466709+0000", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3920000000000003e-06 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.471377+0000", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046680180000000003 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.471464+0000", 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7498999999999997e-05 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.471543+0000", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9021000000000001e-05 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.477625+0000", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060820459999999998 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478569+0000", 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000943431 2024-09-12T21:51:05.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478657+0000", 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8488999999999999e-05 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.478694+0000", 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7030000000000003e-05 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24890 5.3 5:c42787da:::benchmark_data_smithi053_32461_object24889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.525619+0000", 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.017612321, 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791397, 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24890 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525619+0000", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525619+0000", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525619+0000", 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5700000000000002e-07 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525645+0000", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5690999999999998e-05 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525653+0000", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3049999999999993e-06 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.525659+0000", 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9580000000000004e-06 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.530150+0000", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044906140000000004 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.530324+0000", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017384099999999999 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.530418+0000", 2024-09-12T21:51:05.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4782000000000002e-05 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.534701+0000", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00428291 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.537331+0000", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026297899999999999 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.537374+0000", 2024-09-12T21:51:05.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3021e-05 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.537410+0000", 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5927999999999999e-05 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:05.659 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:05.660 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:05.661 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:05.662 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:05.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:05.662 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.659+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.663 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:05.663 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:05.761 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:05.760+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:05.799 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:05.799 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:05.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:05.862 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:05.861+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:05.954 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:05.954 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:05.963 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:05.962+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:05.965 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:06.064 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:06.063+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:06.107 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.107 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:06.165 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:06.164+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:06.259 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.259 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.264 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:51:06.267 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:06.266+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:06.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:06.354 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 7 15 27535 27520 245.694 199.562 0.00354617 0.00406576 2024-09-12T21:51:06.367 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:06.367+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:06.457 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.457 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:06.469 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:06.467+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:06.568 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:06.567+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:06.608 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.608 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:06.669 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:06.668+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:06.767 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.767 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.769 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:06.769+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:06.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:06.870 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:06.869+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:06.971 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:06.970+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:06.974 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:06.974 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:06.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:07.072 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.071+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.130 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:07.130 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:07.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:07.186 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:07.185+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:07.274 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.273+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.281 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:07.281 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:07.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:07.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 8 16 30617 30601 239.051 192.562 0.00490705 0.0041797 2024-09-12T21:51:07.377 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:07.376+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:07.475 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:07.475 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:07.476 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.475+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:07.576 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.576+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.669 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:07.669 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:07.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:07.677 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.676+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:07.778 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:07.777+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:07.803 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:07.803 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:07.822 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:07.822 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:07.826 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32088 5.f 5:fbc66ae5:::benchmark_data_smithi053_32461_object32087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.821659+0000", 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0036328850000000002, 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036607020000000001, 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:07.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32088 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821659+0000", 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821659+0000", 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821659+0000", 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7299999999999996e-07 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821730+0000", 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0518999999999993e-05 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821736+0000", 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.821740+0000", 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8149999999999999e-06 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.822805+0000", 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001064773 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.822896+0000", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1217000000000004e-05 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.822979+0000", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3117999999999999e-05 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824443+0000", 2024-09-12T21:51:07.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001463989 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:32090 5.c e26/21 5:3584b7fe:::benchmark_data_smithi053_32461_object32089:head v 26'1898, mlcod=26'1895)", 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.823105+0000", 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021868909999999998, 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002295914, 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:07.832 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823105+0000", 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823105+0000", 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823105+0000", 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9100000000000004e-07 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823183+0000", 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8355000000000005e-05 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823193+0000", 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3819999999999993e-06 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823199+0000", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1659999999999999e-06 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823248+0000", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8612999999999997e-05 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.823274+0000", 2024-09-12T21:51:07.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6778999999999999e-05 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32092 5.2 5:4f4f46c7:::benchmark_data_smithi053_32461_object32091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824199+0000", 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010928940000000001, 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001264837, 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:07.836 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32092 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824199+0000", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824199+0000", 2024-09-12T21:51:07.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824199+0000", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9700000000000005e-07 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824283+0000", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3294000000000006e-05 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824292+0000", 2024-09-12T21:51:07.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5540000000000003e-06 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824299+0000", 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4130000000000003e-06 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824348+0000", 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9728000000000002e-05 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824457+0000", 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108387 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824539+0000", 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2460000000000007e-05 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32093 5.f 5:fd4502bb:::benchmark_data_smithi053_32461_object32092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824316+0000", 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00097589900000000002, 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012151589999999999, 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32093 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.841 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824316+0000", 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824316+0000", 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824316+0000", 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-07 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824377+0000", 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0647999999999999e-05 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824385+0000", 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6309999999999992e-06 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824390+0000", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6519999999999997e-06 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824480+0000", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9862000000000001e-05 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824588+0000", 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108152 2024-09-12T21:51:07.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824700+0000", 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111872 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32094 5.2 5.1800e92 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824400+0000", 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00089169100000000001, 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011916260000000001, 2024-09-12T21:51:07.845 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32094 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824400+0000", 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824400+0000", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824400+0000", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2099999999999997e-07 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824435+0000", 2024-09-12T21:51:07.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5210999999999999e-05 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824443+0000", 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9300000000000003e-06 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824449+0000", 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.02e-06 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.848 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32100 5.f 5.e4b1e94f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824692+0000", 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00059980600000000004, 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00094530600000000003, 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:07.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32100 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824692+0000", 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824692+0000", 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824692+0000", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.37e-07 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824833+0000", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000140691 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824842+0000", 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4880000000000007e-06 2024-09-12T21:51:07.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824848+0000", 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1279999999999996e-06 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:32095 5.3 e26/21 5:c5f68eea:::benchmark_data_smithi053_32461_object32094:head v 26'2098, mlcod=26'2096)", 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824874+0000", 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000417055, 2024-09-12T21:51:07.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00080945500000000005, 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824874+0000", 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824874+0000", 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824875+0000", 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3599999999999999e-07 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824936+0000", 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1593999999999993e-05 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824945+0000", 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7339999999999997e-06 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824951+0000", 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0970000000000002e-06 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824994+0000", 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2592000000000001e-05 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825013+0000", 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9415e-05 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:32096 5.c e26/21 5:3c19fb56:::benchmark_data_smithi053_32461_object32095:head v 26'1899, mlcod=26'1896)", 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.824964+0000", 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000327752, 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00077271900000000005, 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.856 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824964+0000", 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824964+0000", 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.824964+0000", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0499999999999999e-07 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825003+0000", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9409999999999997e-05 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825011+0000", 2024-09-12T21:51:07.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6240000000000002e-06 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825015+0000", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4680000000000003e-06 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825055+0000", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9836999999999998e-05 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825071+0000", 2024-09-12T21:51:07.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6124e-05 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:32099 5.6 e26/21 5:60c91103:::benchmark_data_smithi053_32461_object32098:head v 26'2022, mlcod=26'2020)", 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.825141+0000", 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00014993499999999999, 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00064572299999999996, 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825141+0000", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825141+0000", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825142+0000", 2024-09-12T21:51:07.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.46e-07 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825208+0000", 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6519999999999993e-05 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825217+0000", 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1899999999999995e-06 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825221+0000", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5859999999999998e-06 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825268+0000", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7178999999999997e-05 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.825287+0000", 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9012e-05 2024-09-12T21:51:07.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 9 2024-09-12T21:51:07.864 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:07.865 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:07.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:07.910 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:07.909+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:07.980 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:07.979+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:08.003 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:08.003 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:08.004 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:08.004 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:08.004 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:08.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:08.080 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:08.079+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:08.087 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T21:51:08.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T21:51:08.182 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:08.181+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:08.192 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.340713931, 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014234999, 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848506+0000", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848508+0000", 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.334e-06 2024-09-12T21:51:08.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848513+0000", 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6990000000000002e-06 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848516+0000", 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6349999999999999e-06 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856735+0000", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082186740000000005 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856800+0000", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5495999999999998e-05 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856936+0000", 2024-09-12T21:51:08.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013602300000000001 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859761+0000", 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028247319999999999 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862641+0000", 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028799590000000001 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862699+0000", 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7525999999999998e-05 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862740+0000", 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1545000000000003e-05 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 28.339238578, 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01277415, 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849981+0000", 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849982+0000", 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.04e-06 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849986+0000", 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7110000000000003e-06 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.849998+0000", 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1647e-05 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.850005+0000", 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1559999999999998e-06 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856859+0000", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068537160000000001 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.857053+0000", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019449800000000001 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862755+0000", 2024-09-12T21:51:08.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057013819999999996 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18259 5.2 5:4460e580:::benchmark_data_smithi053_32461_object18258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6442780299999997, 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015716200999999999, 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18259 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:08.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544942+0000", 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544996+0000", 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3995000000000001e-05 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545001+0000", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545005+0000", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.546e-06 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545379+0000", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00037468100000000003 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545480+0000", 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101196 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545561+0000", 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0630000000000006e-05 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.547246+0000", 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001685211 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560600+0000", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013353535 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560633+0000", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2703000000000002e-05 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560657+0000", 2024-09-12T21:51:08.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4814999999999999e-05 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21125 5.1 5:861c7106:::benchmark_data_smithi053_32461_object21124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8131011309999998, 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012474285999999999, 2024-09-12T21:51:08.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21125 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376118+0000", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376119+0000", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9999999999999998e-07 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376152+0000", 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3300999999999998e-05 2024-09-12T21:51:08.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376159+0000", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6340000000000001e-06 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376166+0000", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3389999999999998e-06 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376205+0000", 2024-09-12T21:51:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9444999999999999e-05 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376338+0000", 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013308300000000001 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376471+0000", 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013258000000000001 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378804+0000", 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023333339999999998 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388501+0000", 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096972159999999998 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388552+0000", 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0237e-05 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388592+0000", 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0617000000000001e-05 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.215 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21126 5.2 5:43240305:::benchmark_data_smithi053_32461_object21125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8130425529999998, 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012465611, 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21126 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376177+0000", 2024-09-12T21:51:08.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9800000000000003e-07 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376221+0000", 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4070999999999999e-05 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376231+0000", 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2450000000000004e-06 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376238+0000", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6320000000000008e-06 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376437+0000", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019865400000000001 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376552+0000", 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011482899999999999 2024-09-12T21:51:08.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376661+0000", 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109731 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378394+0000", 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001732403 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388569+0000", 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010174706 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388606+0000", 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7181000000000002e-05 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388642+0000", 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6560999999999998e-05 2024-09-12T21:51:08.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21128 5.7 5:ec5be353:::benchmark_data_smithi053_32461_object21127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8124490409999998, 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011816129999999999, 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21128 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376770+0000", 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376771+0000", 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.61e-07 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376842+0000", 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1549000000000002e-05 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376856+0000", 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3359e-05 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376863+0000", 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1590000000000004e-06 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376927+0000", 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4362999999999993e-05 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377046+0000", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118186 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000123168 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378868+0000", 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016988470000000001 2024-09-12T21:51:08.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388520+0000", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0096524079999999995 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388552+0000", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2360999999999997e-05 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388586+0000", 2024-09-12T21:51:08.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3969e-05 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21129 5.2 5:4616ce26:::benchmark_data_smithi053_32461_object21128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8122988429999998, 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011844387, 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21129 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376920+0000", 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376921+0000", 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376991+0000", 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9970999999999998e-05 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.376999+0000", 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4300000000000006e-06 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377006+0000", 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2689999999999996e-06 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377473+0000", 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00046779800000000001 2024-09-12T21:51:08.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377593+0000", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011927 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377760+0000", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000167076 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378677+0000", 2024-09-12T21:51:08.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00091693899999999997 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388679+0000", 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010002494000000001 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388731+0000", 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1526000000000001e-05 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388765+0000", 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3971999999999999e-05 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21130 5.7 5:eb8fb8f5:::benchmark_data_smithi053_32461_object21129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8120497790000001, 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011511643, 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21130 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377169+0000", 2024-09-12T21:51:08.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377170+0000", 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7100000000000001e-07 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377194+0000", 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3515000000000001e-05 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377203+0000", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2480000000000002e-06 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377209+0000", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2620000000000004e-06 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.377904+0000", 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00069497799999999996 2024-09-12T21:51:08.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378019+0000", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011523099999999999 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.378148+0000", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012899999999999999 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379148+0000", 2024-09-12T21:51:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00099980500000000009 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388621+0000", 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094731280000000008 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388662+0000", 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0283e-05 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.388681+0000", 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9422000000000001e-05 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:21140 5.2 5:450185a2:::benchmark_data_smithi053_32461_object21139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8094438099999999, 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011781809000000001, 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 21140 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379775+0000", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379776+0000", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.02e-06 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379837+0000", 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0143000000000003e-05 2024-09-12T21:51:08.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379846+0000", 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9830000000000002e-06 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379850+0000", 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000001e-06 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379882+0000", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1699000000000003e-05 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.379956+0000", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4450999999999996e-05 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.380034+0000", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7274000000000006e-05 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.380780+0000", 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00074669700000000005 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391500+0000", 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010720057999999999 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391532+0000", 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1180999999999998e-05 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.391557+0000", 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5533000000000001e-05 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:23088 5.7 5:ecfaba2a:::benchmark_data_smithi053_32461_object23087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.965514+0000", 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2237047240000001, 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012311279, 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.246 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 23088 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965514+0000", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965514+0000", 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965515+0000", 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2900000000000002e-07 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965634+0000", 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118303 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965642+0000", 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0320000000000003e-06 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965647+0000", 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.694e-06 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965678+0000", 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0796999999999997e-05 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965772+0000", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.399e-05 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965857+0000", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5319000000000001e-05 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.967324+0000", 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014666220000000001 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977747+0000", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010422616000000001 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977786+0000", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9341000000000002e-05 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977826+0000", 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9736e-05 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.251 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:23089 5.2 5:4d7f4e18:::benchmark_data_smithi053_32461_object23088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.965692+0000", 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.223527362, 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012247619, 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 23089 2024-09-12T21:51:08.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965692+0000", 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965692+0000", 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965692+0000", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965785+0000", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2967000000000006e-05 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965794+0000", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1179999999999992e-06 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965799+0000", 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7919999999999998e-06 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.966441+0000", 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00064176399999999996 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.966551+0000", 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010966799999999999 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.966665+0000", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114468 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.972554+0000", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058889499999999996 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977891+0000", 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053368030000000002 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977919+0000", 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7766000000000001e-05 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977939+0000", 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0659e-05 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.257 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:23091 5.1 5:82c04fae:::benchmark_data_smithi053_32461_object23090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:04.965808+0000", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.2234108790000002, 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012106123, 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 23091 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965808+0000", 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965808+0000", 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965809+0000", 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0800000000000005e-07 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965855+0000", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6569000000000001e-05 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965868+0000", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2217e-05 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965873+0000", 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9000000000000003e-06 2024-09-12T21:51:08.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.965917+0000", 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3686000000000002e-05 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.966038+0000", 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012088500000000001 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.966178+0000", 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013982099999999999 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.969899+0000", 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037211929999999998 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977852+0000", 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079528329999999994 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977893+0000", 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1264000000000003e-05 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:04.977914+0000", 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1246999999999998e-05 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24220 5.7 5:ed2a18dc:::benchmark_data_smithi053_32461_object24219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.8726369749999998, 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013367179999999999, 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24220 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316583+0000", 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4099999999999999e-07 2024-09-12T21:51:08.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316681+0000", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8423000000000003e-05 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316693+0000", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2244e-05 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316698+0000", 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9309999999999999e-06 2024-09-12T21:51:08.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321457+0000", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047584009999999998 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321554+0000", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6971000000000004e-05 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321638+0000", 2024-09-12T21:51:08.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4296999999999996e-05 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.326640+0000", 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050019540000000003 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329884+0000", 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032438839999999998 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329919+0000", 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5162e-05 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329949+0000", 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0471999999999999e-05 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24225 5.7 5:e1897741:::benchmark_data_smithi053_32461_object24224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:08.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.8724284610000002, 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013263021999999999, 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24225 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1800000000000002e-07 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316947+0000", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000155797 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316952+0000", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.592e-06 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316956+0000", 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5080000000000001e-06 2024-09-12T21:51:08.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322448+0000", 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005491831 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322523+0000", 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5512000000000005e-05 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322599+0000", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5836999999999999e-05 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.326693+0000", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040941179999999999 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329982+0000", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032890929999999999 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330029+0000", 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7157999999999998e-05 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330054+0000", 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4258000000000001e-05 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24229 5.7 5:e3e790e1:::benchmark_data_smithi053_32461_object24228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.316962+0000", 2024-09-12T21:51:08.275 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.8722574829999998, 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013179629999999999, 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24229 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316962+0000", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316962+0000", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316962+0000", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8500000000000002e-07 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.317108+0000", 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000146448 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.317120+0000", 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2012e-05 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.317124+0000", 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.67e-06 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.323257+0000", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061331490000000001 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.323339+0000", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1619000000000006e-05 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.323502+0000", 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016360999999999999 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.326697+0000", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003194475 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330083+0000", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033860660000000001 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330117+0000", 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3810000000000003e-05 2024-09-12T21:51:08.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330141+0000", 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4485999999999999e-05 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:24518 5.3 e25/21 5:ce09bda5:::benchmark_data_smithi053_32461_object24517:head v 25'1602, mlcod=25'1599)", 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.405576+0000", 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.7836433290000002, 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01124386, 2024-09-12T21:51:08.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405576+0000", 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405576+0000", 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405576+0000", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.58e-07 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405653+0000", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6490999999999997e-05 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405670+0000", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7255999999999999e-05 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.405675+0000", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2410000000000003e-06 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.407814+0000", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021387989999999998 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.407866+0000", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1996000000000002e-05 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.416787+0000", 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0089204190000000006 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.416820+0000", 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3200000000000001e-05 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24630 5.f 5:ffdda6ca:::benchmark_data_smithi053_32461_object24629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.443958+0000", 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.745261529, 2024-09-12T21:51:08.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011934706, 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24630 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.443958+0000", 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.443958+0000", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.443958+0000", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444041+0000", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2948999999999995e-05 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444050+0000", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.952e-06 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444057+0000", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5969999999999997e-06 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444331+0000", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000274286 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444475+0000", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014375999999999999 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.444611+0000", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013616499999999999 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.445549+0000", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00093795100000000002 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.455823+0000", 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010274307999999999 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.455855+0000", 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1987999999999999e-05 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.455892+0000", 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6995000000000001e-05 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32127 5.9 5:92c152e9:::benchmark_data_smithi053_32461_object32126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:07.834495+0000", 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.35472386500000003, 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011292976999999999, 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32127 2024-09-12T21:51:08.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834495+0000", 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834495+0000", 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834496+0000", 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9400000000000005e-07 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834623+0000", 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126828 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834631+0000", 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0080000000000002e-06 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.834636+0000", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9710000000000003e-06 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.837551+0000", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002915558 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.837662+0000", 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011077399999999999 2024-09-12T21:51:08.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.837774+0000", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112336 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.840687+0000", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029131029999999998 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.845737+0000", 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050492000000000002 2024-09-12T21:51:08.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.845766+0000", 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9655999999999999e-05 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:07.845788+0000", 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1948999999999999e-05 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:32853 5.2 5:40a1e112:::benchmark_data_smithi053_32461_object32852:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.074583+0000", 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.11463651399999999, 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011993073, 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 32853 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074583+0000", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074583+0000", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074583+0000", 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7100000000000001e-07 2024-09-12T21:51:08.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074613+0000", 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9291000000000001e-05 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074620+0000", 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4109999999999999e-06 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.074637+0000", 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.641e-05 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.077754+0000", 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031178519999999999 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.077862+0000", 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107305 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.077985+0000", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012323400000000001 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.083481+0000", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0054956019999999996 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.086468+0000", 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029871860000000002 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.086538+0000", 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0289000000000004e-05 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.086576+0000", 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7722000000000002e-05 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:33065 5.1 5:8134a045:::benchmark_data_smithi053_32461_object33064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.302 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.144298+0000", 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.044921488000000002, 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011598439, 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33065 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:08.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144298+0000", 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144298+0000", 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144298+0000", 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0999999999999998e-07 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144381+0000", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2610999999999999e-05 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144391+0000", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9089999999999995e-06 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.144396+0000", 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.242e-06 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.146472+0000", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002075463 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.146564+0000", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2520000000000002e-05 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.146660+0000", 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5692999999999993e-05 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.149463+0000", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028034790000000002 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.155818+0000", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063549970000000002 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.155862+0000", 2024-09-12T21:51:08.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4255000000000002e-05 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.155896+0000", 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.366e-05 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:08.308 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:08.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:51:08.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:08.311 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:08.309+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:08.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 9 16 33683 33667 233.779 191.625 0.00228951 0.00427211 2024-09-12T21:51:08.411 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:08.410+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:08.456 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:33958 5.4 e26/21 5:2dddb3e0:::benchmark_data_smithi053_32461_object33957:head v 26'2127, mlcod=26'2123)", 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.454365+0000", 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012020430000000001, 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001224092, 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454365+0000", 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454365+0000", 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454366+0000", 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8500000000000001e-07 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454404+0000", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7837999999999999e-05 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454414+0000", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0774000000000001e-05 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454422+0000", 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5519999999999999e-06 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454457+0000", 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4934000000000001e-05 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.454468+0000", 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1681e-05 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33959 5.3 5:c60b5e2c:::benchmark_data_smithi053_32461_object33958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.455197+0000", 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00036988, 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045367299999999998, 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33959 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455197+0000", 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455197+0000", 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455198+0000", 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.158e-06 2024-09-12T21:51:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455296+0000", 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7083999999999994e-05 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455310+0000", 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4184e-05 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455319+0000", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8990000000000007e-06 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455364+0000", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5068999999999998e-05 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455487+0000", 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123755 2024-09-12T21:51:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455620+0000", 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013253200000000001 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33962 5.c 5:37b05b66:::benchmark_data_smithi053_32461_object33961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.455361+0000", 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00020642499999999999, 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034200300000000001, 2024-09-12T21:51:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33962 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455361+0000", 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455361+0000", 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455361+0000", 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4000000000000001e-07 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455452+0000", 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0649000000000006e-05 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455462+0000", 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8190000000000003e-06 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455468+0000", 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1079999999999998e-06 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455535+0000", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7278000000000002e-05 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455615+0000", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9590000000000002e-05 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.455708+0000", 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3295999999999996e-05 2024-09-12T21:51:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33948 5.3 5:c2fde608:::benchmark_data_smithi053_32461_object33947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.445146+0000", 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010421601000000001, 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010632974, 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33948 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445146+0000", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445146+0000", 2024-09-12T21:51:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445146+0000", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6100000000000001e-07 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445204+0000", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7558e-05 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445214+0000", 2024-09-12T21:51:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0210000000000001e-05 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.445220+0000", 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4989999999999999e-06 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.449500+0000", 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042797089999999996 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.449623+0000", 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012309800000000001 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.449751+0000", 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012782599999999999 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.451200+0000", 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001449133 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:33950 5.b e26/21 5:d6056d18:::benchmark_data_smithi053_32461_object33949:head v 26'2041, mlcod=26'2038)", 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.450116+0000", 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054516429999999999, 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005747594, 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450116+0000", 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450116+0000", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450116+0000", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450179+0000", 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3033000000000004e-05 2024-09-12T21:51:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450190+0000", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1008e-05 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450197+0000", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5749999999999997e-06 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450762+0000", 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056548199999999996 2024-09-12T21:51:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.450780+0000", 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8111999999999999e-05 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 5 2024-09-12T21:51:08.478 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:08.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:08.513 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:08.512+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:08.613 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:08.613+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:08.626 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:08.626 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:08.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:08.714 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:08.713+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:18259 5.2 e25/21 5:4460e580:::benchmark_data_smithi053_32461_object18258:head v 25'1141, mlcod=25'1137)", 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2419482449999997, 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01482526, 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545703+0000", 2024-09-12T21:51:08.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0760999999999997e-05 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545722+0000", 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8606000000000001e-05 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545728+0000", 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.285e-06 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551313+0000", 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055852610000000002 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551331+0000", 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7547e-05 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560433+0000", 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091016819999999998 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560477+0000", 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4400999999999997e-05 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:18262 5.c 5:3390dac7:::benchmark_data_smithi053_32461_object18261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2407713319999996, 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014099459, 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 18262 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546830+0000", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8700000000000004e-07 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546893+0000", 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3465000000000003e-05 2024-09-12T21:51:08.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546901+0000", 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9019999999999999e-06 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546906+0000", 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551185+0000", 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042795699999999999 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551290+0000", 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010442600000000001 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551438+0000", 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014857 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.553548+0000", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002109325 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560619+0000", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070717169999999999 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560882+0000", 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026296799999999998 2024-09-12T21:51:08.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560928+0000", 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5627999999999997e-05 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:20533 5.c 5:3e65c558:::benchmark_data_smithi053_32461_object20532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.577956801, 2024-09-12T21:51:08.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012693705, 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 20533 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209643+0000", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209644+0000", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209779+0000", 2024-09-12T21:51:08.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013489799999999999 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209785+0000", 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0079999999999999e-06 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.209788+0000", 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7720000000000001e-06 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.210972+0000", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001183981 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.211050+0000", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7097999999999999e-05 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.211194+0000", 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417 2024-09-12T21:51:08.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.215777+0000", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045833580000000001 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222219+0000", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064416530000000003 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222291+0000", 2024-09-12T21:51:08.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1983000000000005e-05 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:04.222337+0000", 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6146000000000002e-05 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23644 5.6 5:61770153:::benchmark_data_smithi053_32461_object23643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6473190139999998, 2024-09-12T21:51:08.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014971791, 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23644 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:08.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140282+0000", 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140402+0000", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140414+0000", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140421+0000", 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7100000000000007e-06 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140865+0000", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000443724 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140980+0000", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115148 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141097+0000", 2024-09-12T21:51:08.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116876 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142829+0000", 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017317820000000001 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155134+0000", 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012305015000000001 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155201+0000", 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6802000000000002e-05 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155253+0000", 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2082e-05 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24518 5.3 5:ce09bda5:::benchmark_data_smithi053_32461_object24517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.383058814, 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01429952, 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24518 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404542+0000", 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405188+0000", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064633900000000001 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405198+0000", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3130000000000004e-06 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405204+0000", 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379999999999996e-06 2024-09-12T21:51:08.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405248+0000", 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.354e-05 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405356+0000", 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107532 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405486+0000", 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130109 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409406+0000", 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039201740000000002 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418737+0000", 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093307640000000001 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418802+0000", 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5257000000000002e-05 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418841+0000", 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8824e-05 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24519 5.3 5:ce535336:::benchmark_data_smithi053_32461_object24518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.3823821590000001, 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013759295, 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24519 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405219+0000", 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405249+0000", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405256+0000", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2320000000000004e-06 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405262+0000", 2024-09-12T21:51:08.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7830000000000004e-06 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406483+0000", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012208189999999999 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406574+0000", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1508999999999994e-05 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406659+0000", 2024-09-12T21:51:08.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4444999999999995e-05 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409429+0000", 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027704940000000001 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418893+0000", 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094641670000000008 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418945+0000", 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1697000000000003e-05 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418977+0000", 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2199000000000001e-05 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24626 5.a 5:50037ab4:::benchmark_data_smithi053_32461_object24625:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.3449756690000001, 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013314127, 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24626 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442624+0000", 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442625+0000", 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442784+0000", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015933599999999999 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442793+0000", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8429999999999999e-06 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.442799+0000", 2024-09-12T21:51:08.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2179999999999996e-06 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444084+0000", 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012851830000000001 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444202+0000", 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117689 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.444341+0000", 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013924400000000001 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.445946+0000", 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001604826 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455828+0000", 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098820430000000001 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455894+0000", 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5258000000000004e-05 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.455938+0000", 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4904999999999998e-05 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:32146 5.a 5:55fd904a:::benchmark_data_smithi053_32461_object32145:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:07.842530+0000", 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.94506998200000003, 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01296576, 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 32146 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842530+0000", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842530+0000", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842530+0000", 2024-09-12T21:51:08.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9599999999999999e-07 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842555+0000", 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4244999999999999e-05 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842563+0000", 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9489999999999996e-06 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842568+0000", 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9710000000000003e-06 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.844121+0000", 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015534800000000001 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.844202+0000", 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0476000000000007e-05 2024-09-12T21:51:08.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.844275+0000", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3759999999999999e-05 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.850444+0000", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061686709999999997 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855408+0000", 2024-09-12T21:51:08.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049636469999999999 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855454+0000", 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6272e-05 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855496+0000", 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1792999999999998e-05 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:32147 5.a 5:57506ce9:::benchmark_data_smithi053_32461_object32146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:07.842575+0000", 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.94502503199999999, 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013002243, 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 32147 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842575+0000", 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842575+0000", 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842575+0000", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4299999999999998e-07 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842631+0000", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269000000000002e-05 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842638+0000", 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9190000000000002e-06 2024-09-12T21:51:08.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.842643+0000", 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9609999999999996e-06 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.846984+0000", 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043416430000000001 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.847092+0000", 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107543 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.847208+0000", 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011602700000000001 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.850487+0000", 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032797299999999998 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855505+0000", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050171809999999999 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855546+0000", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1047999999999997e-05 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.855577+0000", 2024-09-12T21:51:08.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1479000000000001e-05 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:32531 5.3 5:c51b4191:::benchmark_data_smithi053_32461_object32530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:07.967226+0000", 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.82037412099999996, 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012495522, 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 32531 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967226+0000", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967226+0000", 2024-09-12T21:51:08.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967226+0000", 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967349+0000", 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012211899999999999 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967356+0000", 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2359999999999998e-06 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967361+0000", 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7030000000000003e-06 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967406+0000", 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4067999999999999e-05 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967516+0000", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011000799999999999 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.967636+0000", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120847 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.971475+0000", 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038389240000000001 2024-09-12T21:51:08.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.979636+0000", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081602150000000002 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.979686+0000", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0081999999999999e-05 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:07.979721+0000", 2024-09-12T21:51:08.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5729999999999998e-05 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33661 5.5 5:a785fdf9:::benchmark_data_smithi053_32461_object33660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44647182800000002, 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014096894, 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33661 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:08.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341129+0000", 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341157+0000", 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8377999999999998e-05 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341164+0000", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2679999999999997e-06 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341171+0000", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0099999999999998e-06 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341217+0000", 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5893000000000003e-05 2024-09-12T21:51:08.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341355+0000", 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013802700000000001 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341480+0000", 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012479599999999999 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.343388+0000", 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019079190000000001 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355171+0000", 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011782892 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355203+0000", 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2038000000000001e-05 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355225+0000", 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2106000000000001e-05 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33708 5.6 5:67c5c786:::benchmark_data_smithi053_32461_object33707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.361712+0000", 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.42588766300000003, 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012397648000000001, 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33708 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361712+0000", 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361712+0000", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361713+0000", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361764+0000", 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0420000000000002e-05 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361774+0000", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9510000000000001e-06 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361781+0000", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1629999999999999e-06 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361823+0000", 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1801000000000002e-05 2024-09-12T21:51:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361925+0000", 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010194100000000001 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.362011+0000", 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6409000000000006e-05 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.364100+0000", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020888180000000001 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.374005+0000", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099056060000000008 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.374074+0000", 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8798000000000001e-05 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.374110+0000", 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5661999999999998e-05 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:33707 5.e e26/21 5:73eae7d5:::benchmark_data_smithi053_32461_object33706:head v 26'2168, mlcod=26'2165)", 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.361921+0000", 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.425679111, 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013048799, 2024-09-12T21:51:08.862 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361921+0000", 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361921+0000", 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.361922+0000", 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5799999999999998e-07 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.362009+0000", 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7107999999999993e-05 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.362020+0000", 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0875e-05 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.362028+0000", 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.364003+0000", 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019750890000000002 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.364041+0000", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7923999999999998e-05 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.374937+0000", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010896123000000001 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.374970+0000", 2024-09-12T21:51:08.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3006999999999998e-05 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33819 5.5 5:aa80b713:::benchmark_data_smithi053_32461_object33818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.399682+0000", 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.38791780999999997, 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013048158000000001, 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33819 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399682+0000", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399682+0000", 2024-09-12T21:51:08.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399683+0000", 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.052e-06 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399742+0000", 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8556e-05 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399753+0000", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0762e-05 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399759+0000", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5880000000000003e-06 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399808+0000", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8934999999999998e-05 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399956+0000", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014794299999999999 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.400092+0000", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136427 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.403915+0000", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038227249999999999 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412642+0000", 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087270569999999999 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412687+0000", 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4608999999999999e-05 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412730+0000", 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3504000000000002e-05 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33820 5.c 5:3e93c975:::benchmark_data_smithi053_32461_object33819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.399773+0000", 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.38782723099999999, 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012923535, 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33820 2024-09-12T21:51:08.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399773+0000", 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399773+0000", 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399773+0000", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0999999999999998e-07 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399799+0000", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5395e-05 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399806+0000", 2024-09-12T21:51:08.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.399811+0000", 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1800000000000004e-06 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.400227+0000", 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041613400000000002 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.400339+0000", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112015 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.400459+0000", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011982 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.403909+0000", 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034495720000000001 2024-09-12T21:51:08.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412547+0000", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086378280000000002 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412594+0000", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7457999999999999e-05 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.412696+0000", 2024-09-12T21:51:08.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102242 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:33833 5.7 e26/21 5:e25343b7:::benchmark_data_smithi053_32461_object33832:head v 26'2115, mlcod=26'2112)", 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.407603+0000", 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.379996732, 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012455157, 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407603+0000", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407603+0000", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407604+0000", 2024-09-12T21:51:08.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-07 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407663+0000", 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9483e-05 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407670+0000", 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5930000000000002e-06 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407675+0000", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0849999999999996e-06 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407706+0000", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0895000000000002e-05 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.407719+0000", 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3053e-05 2024-09-12T21:51:08.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.419979+0000", 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012259661 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.420058+0000", 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9857000000000005e-05 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33981 5.a 5:5447de07:::benchmark_data_smithi053_32461_object33980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32717391000000001, 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013529405, 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33981 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.884 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460427+0000", 2024-09-12T21:51:08.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0299999999999998e-07 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460519+0000", 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2363999999999999e-05 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460528+0000", 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.49e-06 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460537+0000", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7620000000000007e-06 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.461981+0000", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001443338 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.462138+0000", 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015754699999999999 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.462288+0000", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014925 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.470215+0000", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079274810000000001 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473898+0000", 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036824959999999999 2024-09-12T21:51:08.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473931+0000", 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2944000000000002e-05 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473955+0000", 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.493e-05 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:34088 5.2 e26/21 5:4e395165:::benchmark_data_smithi053_32461_object34087:head v 26'2154, mlcod=26'2151)", 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.28343940400000001, 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599526, 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504378+0000", 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021676099999999999 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504384+0000", 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4529999999999999e-06 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504389+0000", 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505542+0000", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001153081 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505561+0000", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9737000000000001e-05 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520723+0000", 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015161604 2024-09-12T21:51:08.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520760+0000", 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6992000000000001e-05 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34838 5.3 5:c4330a9f:::benchmark_data_smithi053_32461_object34837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.020112188999999999, 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013876515000000001, 2024-09-12T21:51:08.894 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34838 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767522+0000", 2024-09-12T21:51:08.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3930000000000002e-05 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767531+0000", 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3890000000000005e-06 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767536+0000", 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.967e-06 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772807+0000", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005271342 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772935+0000", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804299999999999 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.773070+0000", 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135007 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778166+0000", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050958510000000002 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781281+0000", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031145729999999998 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781327+0000", 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6582999999999998e-05 2024-09-12T21:51:08.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781364+0000", 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7200000000000003e-05 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34843 5.3 5:c19f014c:::benchmark_data_smithi053_32461_object34842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.018538486999999999, 2024-09-12T21:51:08.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015791453, 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34843 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769062+0000", 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8599999999999998e-07 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:08.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769180+0000", 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117528 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769188+0000", 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769193+0000", 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2909999999999998e-06 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775815+0000", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066217089999999999 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775962+0000", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146761 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.776105+0000", 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143688 2024-09-12T21:51:08.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778491+0000", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023859549999999999 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784760+0000", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062689449999999997 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784806+0000", 2024-09-12T21:51:08.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6283999999999999e-05 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784853+0000", 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6437999999999998e-05 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:08.906 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:08.908 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:08.908 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:08.906+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:09.009 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:09.008+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:35644 5.f e26/21 5:f8712570:::benchmark_data_smithi053_32461_object35643:head v 26'2231, mlcod=26'2229)", 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.044081+0000", 2024-09-12T21:51:09.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002582113, 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026036850000000001, 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044081+0000", 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044081+0000", 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044082+0000", 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.37e-07 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044149+0000", 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7062000000000003e-05 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044160+0000", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1493e-05 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044167+0000", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3729999999999998e-06 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044235+0000", 2024-09-12T21:51:09.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8785e-05 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044258+0000", 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2537000000000001e-05 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35645 5.0 5:0092141b:::benchmark_data_smithi053_32461_object35644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.044658+0000", 2024-09-12T21:51:09.052 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020049249999999998, 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021059239999999999, 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35645 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044658+0000", 2024-09-12T21:51:09.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044658+0000", 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044659+0000", 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1900000000000001e-07 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044719+0000", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9451999999999999e-05 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044729+0000", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0688e-05 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044734+0000", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.95e-06 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044778+0000", 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3588999999999999e-05 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044895+0000", 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116809 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045017+0000", 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121946 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.056 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35646 5.d 5:bb9805b4:::benchmark_data_smithi053_32461_object35645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.044751+0000", 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001912555, 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020597760000000001, 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.057 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35646 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044751+0000", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044751+0000", 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044751+0000", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6300000000000005e-07 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044830+0000", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9138e-05 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044837+0000", 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5250000000000002e-06 2024-09-12T21:51:09.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044841+0000", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2400000000000001e-06 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044883+0000", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2104000000000002e-05 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044974+0000", 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1250999999999998e-05 2024-09-12T21:51:09.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045065+0000", 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1028999999999999e-05 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35647 5.0 5:0f02ac67:::benchmark_data_smithi053_32461_object35646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.044853+0000", 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018105809999999999, 2024-09-12T21:51:09.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019965460000000001, 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35647 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044853+0000", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044853+0000", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044853+0000", 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9399999999999995e-07 2024-09-12T21:51:09.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044897+0000", 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3741e-05 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044904+0000", 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.306e-06 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044910+0000", 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9529999999999996e-06 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.046231+0000", 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001320718 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.046357+0000", 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012585100000000001 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.046496+0000", 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000139171 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:35650 5.9 e26/21 5:93ae8409:::benchmark_data_smithi053_32461_object35649:head v 26'2211, mlcod=26'2209)", 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.045439+0000", 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0012244980000000001, 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001453537, 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.066 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045439+0000", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045439+0000", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045439+0000", 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7599999999999997e-07 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045496+0000", 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6267000000000002e-05 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045505+0000", 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9940000000000006e-06 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045510+0000", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7849999999999997e-06 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045561+0000", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0358999999999997e-05 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.045581+0000", 2024-09-12T21:51:09.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9973999999999999e-05 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35635 5.8 5:18e6fe88:::benchmark_data_smithi053_32461_object35634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.041032+0000", 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0056310099999999997, 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058929519999999999, 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.070 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35635 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041032+0000", 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041032+0000", 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041033+0000", 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0900000000000001e-07 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041170+0000", 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000137527 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041178+0000", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4909999999999999e-06 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041182+0000", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0879999999999997e-06 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041516+0000", 2024-09-12T21:51:09.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00033405000000000002 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041630+0000", 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011451300000000001 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041772+0000", 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141287 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35637 5.4 5:2c460697:::benchmark_data_smithi053_32461_object35636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.041212+0000", 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.005451104, 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057515170000000003, 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35637 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041212+0000", 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041212+0000", 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041212+0000", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7899999999999999e-07 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041244+0000", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1712999999999999e-05 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041250+0000", 2024-09-12T21:51:09.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6230000000000002e-06 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041253+0000", 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5420000000000001e-06 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041288+0000", 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5061999999999997e-05 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041388+0000", 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9592999999999993e-05 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041508+0000", 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011974899999999999 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35638 5.d 5:b065e553:::benchmark_data_smithi053_32461_object35637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.079 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.041261+0000", 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054018629999999998, 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057418080000000002, 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35638 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041261+0000", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041261+0000", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041262+0000", 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3099999999999998e-07 2024-09-12T21:51:09.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041296+0000", 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4309e-05 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041302+0000", 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3800000000000002e-06 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041305+0000", 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7160000000000001e-06 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041343+0000", 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8245999999999999e-05 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041440+0000", 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6434000000000005e-05 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041520+0000", 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0521999999999999e-05 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044385+0000", 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028642899999999998 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35639 5.e 5:79c61490:::benchmark_data_smithi053_32461_object35638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.041773+0000", 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048905490000000001, 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00527124, 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35639 2024-09-12T21:51:09.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041773+0000", 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041773+0000", 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041773+0000", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5300000000000003e-07 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041857+0000", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3455999999999995e-05 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041874+0000", 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7024000000000002e-05 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041884+0000", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7359999999999996e-06 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041936+0000", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2367000000000002e-05 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.042073+0000", 2024-09-12T21:51:09.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013690600000000001 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.042206+0000", 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013266299999999999 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35640 5.b 5:dab6ec9b:::benchmark_data_smithi053_32461_object35639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.089 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.041903+0000", 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047605579999999998, 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052089390000000001, 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35640 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041903+0000", 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041903+0000", 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041903+0000", 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7000000000000003e-07 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041936+0000", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2747999999999999e-05 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041945+0000", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0410000000000003e-06 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.041952+0000", 2024-09-12T21:51:09.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2949999999999999e-06 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.042010+0000", 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8403000000000003e-05 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.042134+0000", 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012421599999999999 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.042258+0000", 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012368500000000001 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35642 5.8 5:1f4779e1:::benchmark_data_smithi053_32461_object35641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.043577+0000", 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030865990000000002, 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036085499999999999, 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.094 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35642 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043577+0000", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043577+0000", 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043577+0000", 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8100000000000001e-07 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043696+0000", 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118515 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043708+0000", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2353e-05 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.043716+0000", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0790000000000001e-06 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044605+0000", 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088875300000000005 2024-09-12T21:51:09.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044745+0000", 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013977999999999999 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.044888+0000", 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014317900000000001 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.098 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-09-12T21:51:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-09-12T21:51:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:09.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:09.110 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:09.109+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:09.211 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:09.210+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:09.270 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T21:51:09.272 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:51:09.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T21:51:09.287 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:09.287 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:51:09.287 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-09-12T21:51:09.287 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-09-12T21:51:09.287 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:09.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:09.312 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:09.311+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:09.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 10 16 36571 36555 228.45 180.5 0.00572889 0.00437416 2024-09-12T21:51:09.412 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:09.412+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:21139 5.b 5:dc3ad759:::benchmark_data_smithi053_32461_object21138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.0540569209999999, 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012331592000000001, 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21139 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379151+0000", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.09e-07 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379221+0000", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0544999999999996e-05 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379229+0000", 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0320000000000003e-06 2024-09-12T21:51:09.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379234+0000", 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.775e-06 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379267+0000", 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3003999999999998e-05 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379347+0000", 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9589e-05 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379422+0000", 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5605000000000005e-05 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.380307+0000", 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088479300000000004 2024-09-12T21:51:09.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391392+0000", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011084513000000001 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391445+0000", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3204000000000001e-05 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391482+0000", 2024-09-12T21:51:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6723000000000001e-05 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:21914 5.e 5:7df26efe:::benchmark_data_smithi053_32461_object21913:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.616325+0000", 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.8168819840000001, 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011810446, 2024-09-12T21:51:09.444 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21914 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616325+0000", 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616325+0000", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616326+0000", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4000000000000001e-07 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616393+0000", 2024-09-12T21:51:09.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7551000000000004e-05 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616404+0000", 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0827e-05 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616411+0000", 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7619999999999998e-06 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616463+0000", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1952e-05 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616548+0000", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5629000000000003e-05 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.616639+0000", 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0492e-05 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.620295+0000", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036565349999999998 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.628046+0000", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077503959999999997 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.628099+0000", 2024-09-12T21:51:09.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2833000000000001e-05 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.628135+0000", 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6729e-05 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:23090 5.4 5:2e81616b:::benchmark_data_smithi053_32461_object23089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:09.450 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4674477479999997, 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01213414, 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 23090 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:09.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965760+0000", 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3799999999999996e-07 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965819+0000", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9373999999999998e-05 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965829+0000", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4939999999999992e-06 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965835+0000", 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9529999999999996e-06 2024-09-12T21:51:09.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965884+0000", 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9539000000000001e-05 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966010+0000", 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012580600000000001 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966140+0000", 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013002000000000001 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.968987+0000", 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00284688 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977819+0000", 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088322220000000007 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977854+0000", 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4391000000000003e-05 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977893+0000", 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9523000000000001e-05 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.456 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:23093 5.4 5:2d931837:::benchmark_data_smithi053_32461_object23092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.965946+0000", 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4672608440000001, 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012028337, 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 23093 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965946+0000", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965946+0000", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965947+0000", 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2500000000000004e-07 2024-09-12T21:51:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966008+0000", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0915999999999997e-05 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966018+0000", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9799999999999993e-06 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966025+0000", 2024-09-12T21:51:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8260000000000004e-06 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966820+0000", 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00079566599999999999 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966918+0000", 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8169000000000001e-05 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966996+0000", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7906999999999998e-05 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.969010+0000", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020136709999999999 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977922+0000", 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089122720000000006 2024-09-12T21:51:09.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977948+0000", 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5542e-05 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977974+0000", 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6563e-05 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:24631 5.e 5:77361b84:::benchmark_data_smithi053_32461_object24630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:05.443969+0000", 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9892380630000002, 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011818172, 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24631 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.443969+0000", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.443969+0000", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.443970+0000", 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7000000000000004e-07 2024-09-12T21:51:09.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444083+0000", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113606 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444095+0000", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1396000000000001e-05 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444103+0000", 2024-09-12T21:51:09.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1559999999999995e-06 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444149+0000", 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5838999999999999e-05 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444271+0000", 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012257199999999999 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.444401+0000", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129992 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.453232+0000", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088305280000000007 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.455702+0000", 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024702119999999998 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.455749+0000", 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7423999999999999e-05 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.455787+0000", 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7676999999999999e-05 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.468 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:24637 5.e 5:70c50983:::benchmark_data_smithi053_32461_object24636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:05.445592+0000", 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.987615264, 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011708609, 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 24637 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445592+0000", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445592+0000", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445592+0000", 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.99e-07 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445640+0000", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7366e-05 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445647+0000", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7579999999999992e-06 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.445653+0000", 2024-09-12T21:51:09.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.450281+0000", 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046286000000000001 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.450463+0000", 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018123400000000001 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.450590+0000", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127618 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.453299+0000", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027087140000000001 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.457190+0000", 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003891215 2024-09-12T21:51:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.457253+0000", 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2662000000000004e-05 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:05.457300+0000", 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7327999999999998e-05 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:32767 5.0 5:0f59ad8c:::benchmark_data_smithi053_32461_object32766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.388976164, 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012670320000000001, 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 32767 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.475 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999999e-07 2024-09-12T21:51:09.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044363+0000", 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013128 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044368+0000", 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2020000000000003e-06 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044371+0000", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6009999999999999e-06 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045181+0000", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080990000000000001 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045306+0000", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012480999999999999 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045425+0000", 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118447 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.048953+0000", 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035280839999999999 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056844+0000", 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078913790000000004 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056878+0000", 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4289999999999999e-05 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056901+0000", 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2731e-05 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33574 5.0 5:03ed3d84:::benchmark_data_smithi053_32461_object33573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.480 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.120205181, 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012351961, 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33574 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:09.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.92e-07 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313060+0000", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7497000000000002e-05 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313067+0000", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2819999999999999e-06 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313071+0000", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1540000000000004e-06 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313131+0000", 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9923000000000002e-05 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313253+0000", 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121456 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313375+0000", 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012266800000000001 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.317117+0000", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003741861 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325302+0000", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081848040000000004 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325330+0000", 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8357999999999999e-05 2024-09-12T21:51:09.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325354+0000", 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3166000000000001e-05 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33577 5.8 5:1bda07d3:::benchmark_data_smithi053_32461_object33576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.313402+0000", 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.11980466, 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011997323000000001, 2024-09-12T21:51:09.486 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33577 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313402+0000", 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313402+0000", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313403+0000", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7199999999999999e-07 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313443+0000", 2024-09-12T21:51:09.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0266999999999999e-05 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313450+0000", 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.652e-06 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313455+0000", 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3789999999999997e-06 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313500+0000", 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4468000000000002e-05 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313613+0000", 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113557 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313739+0000", 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012595999999999999 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.317145+0000", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034060309999999999 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325358+0000", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082129200000000003 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325381+0000", 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2926e-05 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325400+0000", 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8590999999999999e-05 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33707 5.e 5:73eae7d5:::benchmark_data_smithi053_32461_object33706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0716598049999999, 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013616368, 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33707 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361548+0000", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1299999999999999e-07 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361631+0000", 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2731999999999993e-05 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361642+0000", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1766000000000001e-05 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361649+0000", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8159999999999996e-06 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361688+0000", 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8483999999999999e-05 2024-09-12T21:51:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361762+0000", 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4380000000000003e-05 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361845+0000", 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3212000000000002e-05 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.365488+0000", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036427030000000002 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375109+0000", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096212829999999996 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375140+0000", 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1197e-05 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375163+0000", 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3082e-05 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33803 5.e 5:78bbe0ff:::benchmark_data_smithi053_32461_object33802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.392540+0000", 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0406673529999999, 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011689398, 2024-09-12T21:51:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33803 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392540+0000", 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392540+0000", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392540+0000", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3700000000000001e-07 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392604+0000", 2024-09-12T21:51:09.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3581e-05 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392612+0000", 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392618+0000", 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7819999999999999e-06 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392660+0000", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1572000000000001e-05 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392771+0000", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111477 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.392890+0000", 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118935 2024-09-12T21:51:09.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.394349+0000", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001459094 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.404175+0000", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098254870000000008 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.404206+0000", 2024-09-12T21:51:09.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1541000000000002e-05 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.404229+0000", 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2806000000000002e-05 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33823 5.4 5:250ef8ff:::benchmark_data_smithi053_32461_object33822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:09.504 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0330740979999999, 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012740616, 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33823 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:09.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.99e-07 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400233+0000", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9438000000000006e-05 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400242+0000", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400248+0000", 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0190000000000003e-06 2024-09-12T21:51:09.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400290+0000", 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2052000000000003e-05 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400434+0000", 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014423600000000001 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400541+0000", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106549 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401879+0000", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001338285 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412781+0000", 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010901611 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412831+0000", 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9688999999999998e-05 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412873+0000", 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2858000000000002e-05 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.510 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33824 5.4 5:20c4d936:::benchmark_data_smithi053_32461_object33823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0327862969999999, 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012609146999999999, 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33824 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1399999999999996e-07 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400448+0000", 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6795999999999999e-05 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400458+0000", 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5310000000000007e-06 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400464+0000", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0809999999999999e-06 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401158+0000", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000694037 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401238+0000", 2024-09-12T21:51:09.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0457999999999994e-05 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401315+0000", 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6380999999999999e-05 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.402455+0000", 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00114057 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412912+0000", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010456933 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412967+0000", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4765999999999997e-05 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.413030+0000", 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2780000000000005e-05 2024-09-12T21:51:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33984 5.b 5:d638e3a7:::benchmark_data_smithi053_32461_object33983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.461769+0000", 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.97143785500000002, 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012026176, 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33984 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461769+0000", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461769+0000", 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461770+0000", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4799999999999997e-07 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461858+0000", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8164999999999994e-05 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461871+0000", 2024-09-12T21:51:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3183999999999999e-05 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461877+0000", 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3700000000000003e-06 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.461930+0000", 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2951000000000002e-05 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462019+0000", 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9431000000000005e-05 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462139+0000", 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120295 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.468641+0000", 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0065015189999999999 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473710+0000", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050690689999999998 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473757+0000", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7417999999999999e-05 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473795+0000", 2024-09-12T21:51:09.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7926000000000002e-05 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33986 5.b 5:dddf5ce7:::benchmark_data_smithi053_32461_object33985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.462193+0000", 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.97101369000000004, 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011681931, 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33986 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462193+0000", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462193+0000", 2024-09-12T21:51:09.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462194+0000", 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1699999999999997e-07 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462251+0000", 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7090999999999999e-05 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462261+0000", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0208e-05 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.462269+0000", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0809999999999994e-06 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.465546+0000", 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032769869999999999 2024-09-12T21:51:09.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.465651+0000", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104627 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.465729+0000", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7527999999999994e-05 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.471276+0000", 2024-09-12T21:51:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055470739999999999 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473803+0000", 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025275749999999998 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473839+0000", 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.473875+0000", 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5782999999999999e-05 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:34632 5.8 5:111e59cf:::benchmark_data_smithi053_32461_object34631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.692220+0000", 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.74098706000000003, 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011680352999999999, 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34632 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692220+0000", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692220+0000", 2024-09-12T21:51:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692220+0000", 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1900000000000002e-07 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692274+0000", 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3480999999999998e-05 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692282+0000", 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9019999999999999e-06 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.692287+0000", 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.696546+0000", 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042591110000000003 2024-09-12T21:51:09.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.696666+0000", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119633 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.696875+0000", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020932500000000001 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.699034+0000", 2024-09-12T21:51:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021590139999999999 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.703825+0000", 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047907870000000003 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.703876+0000", 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0763000000000002e-05 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.703900+0000", 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4239999999999998e-05 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:34951 5.0 5:02df5328:::benchmark_data_smithi053_32461_object34950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.62440751699999997, 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013370132999999999, 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.535 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34951 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808800+0000", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808875+0000", 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5116000000000004e-05 2024-09-12T21:51:09.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808883+0000", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1839999999999999e-06 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808896+0000", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2318e-05 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808942+0000", 2024-09-12T21:51:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6164e-05 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.809073+0000", 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000131617 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.809188+0000", 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115041 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.810747+0000", 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015582250000000001 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822108+0000", 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011361338 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822143+0000", 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5410000000000001e-05 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822169+0000", 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6086999999999999e-05 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35115 5.0 5:01e8d215:::benchmark_data_smithi053_32461_object35114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.56709944599999995, 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013392878, 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35115 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866108+0000", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8699999999999995e-07 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866185+0000", 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6627999999999999e-05 2024-09-12T21:51:09.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866191+0000", 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2859999999999996e-06 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866194+0000", 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.253e-06 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866225+0000", 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0867000000000001e-05 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866304+0000", 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866383+0000", 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9221999999999995e-05 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.868291+0000", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019078369999999999 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879430+0000", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011139438 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879465+0000", 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5160000000000002e-05 2024-09-12T21:51:09.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879500+0000", 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4984999999999998e-05 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:36513 5.d 5:b5497469:::benchmark_data_smithi053_32461_object36512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.332057+0000", 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.101149576, 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012000139999999999, 2024-09-12T21:51:09.547 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36513 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332057+0000", 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332057+0000", 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332058+0000", 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1999999999999998e-07 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332119+0000", 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0372999999999999e-05 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332129+0000", 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0056e-05 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332137+0000", 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9289999999999998e-06 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332300+0000", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016348799999999999 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332378+0000", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7545000000000004e-05 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.332453+0000", 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5288000000000002e-05 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.333311+0000", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085855199999999995 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.344000+0000", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010688957000000001 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.344033+0000", 2024-09-12T21:51:09.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2959000000000001e-05 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.344057+0000", 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4073000000000001e-05 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:36611 5.f e27/21 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head v 27'2289, mlcod=27'2285)", 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.057970836999999997, 2024-09-12T21:51:09.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013594696, 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:09.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8799999999999998e-07 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375318+0000", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2051000000000004e-05 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375326+0000", 2024-09-12T21:51:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4259999999999997e-06 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375331+0000", 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0459999999999996e-06 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375368+0000", 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7379999999999998e-05 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375385+0000", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6322999999999999e-05 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.388773+0000", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013388666 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.388831+0000", 2024-09-12T21:51:09.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7416000000000001e-05 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:09.558 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:09.559 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:09.558+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:09.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:09.660 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:09.660+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:09.693 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:09.693 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:37497 5.1 5:87eda974:::benchmark_data_smithi053_32461_object37496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.685602+0000", 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0066679119999999998, 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066941960000000003, 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.694 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 37497 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685602+0000", 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685602+0000", 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685602+0000", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4000000000000002e-07 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685679+0000", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6763999999999999e-05 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685685+0000", 2024-09-12T21:51:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.494e-06 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.685691+0000", 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5890000000000002e-06 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.687138+0000", 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014472969999999999 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.687262+0000", 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012328099999999999 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.687394+0000", 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000132049 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.688876+0000", 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014821109999999999 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:37492 5.c e27/21 5:3b0eec86:::benchmark_data_smithi053_32461_object37491:head v 27'2265, mlcod=27'2259)", 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.690844+0000", 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0014253270000000001, 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001527544, 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690844+0000", 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690844+0000", 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690845+0000", 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6899999999999998e-07 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690901+0000", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6028e-05 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690907+0000", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1500000000000004e-06 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690910+0000", 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8e-06 2024-09-12T21:51:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690950+0000", 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9929999999999999e-05 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.690972+0000", 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1273000000000001e-05 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:37503 5.9 5:9368aacb:::benchmark_data_smithi053_32461_object37502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.691369+0000", 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00090084500000000005, 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001059337, 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 37503 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691369+0000", 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691369+0000", 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691369+0000", 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.44e-07 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691555+0000", 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00018587599999999999 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691563+0000", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1219999999999995e-06 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691568+0000", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2490000000000003e-06 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691597+0000", 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.915e-05 2024-09-12T21:51:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691671+0000", 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4449999999999994e-05 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691754+0000", 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3116999999999997e-05 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:37506 5.7 5:e2c5294e:::benchmark_data_smithi053_32461_object37505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.691577+0000", 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00069198299999999996, 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00092322699999999999, 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 37506 2024-09-12T21:51:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691577+0000", 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691577+0000", 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691578+0000", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7300000000000002e-07 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691670+0000", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2058000000000005e-05 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691675+0000", 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9749999999999998e-06 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691678+0000", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2710000000000001e-06 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691725+0000", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6718000000000002e-05 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691863+0000", 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013843800000000001 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692004+0000", 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000140526 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:37498 5.c e27/21 5:3f64d339:::benchmark_data_smithi053_32461_object37497:head v 27'2266, mlcod=27'2260)", 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.691753+0000", 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00051679600000000003, 2024-09-12T21:51:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00081092100000000004, 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691753+0000", 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691753+0000", 2024-09-12T21:51:09.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691762+0000", 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0880000000000001e-06 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691800+0000", 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8101e-05 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691809+0000", 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.867e-06 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691815+0000", 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2890000000000003e-06 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691856+0000", 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1260999999999997e-05 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.691872+0000", 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5498e-05 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:37502 5.5 e27/21 5:ac7a07bb:::benchmark_data_smithi053_32461_object37501:head v 27'2342, mlcod=27'2340)", 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.692037+0000", 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00023227, 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000576743, 2024-09-12T21:51:09.716 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692037+0000", 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692037+0000", 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692038+0000", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8899999999999999e-07 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692063+0000", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4939e-05 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692070+0000", 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7409999999999992e-06 2024-09-12T21:51:09.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692076+0000", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7309999999999998e-06 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692122+0000", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5785000000000003e-05 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692140+0000", 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8062000000000001e-05 2024-09-12T21:51:09.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:37505 5.d e27/21 5:b1e88e99:::benchmark_data_smithi053_32461_object37504:head v 27'2354, mlcod=27'2352)", 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.692058+0000", 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00021147000000000001, 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00060669100000000002, 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692058+0000", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692058+0000", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692059+0000", 2024-09-12T21:51:09.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692157+0000", 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8857999999999994e-05 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692170+0000", 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2183e-05 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692176+0000", 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2530000000000001e-06 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692230+0000", 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3820000000000003e-05 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692249+0000", 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9301999999999999e-05 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.723 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:37504 5.3 e27/21 5:cf1cdceb:::benchmark_data_smithi053_32461_object37503:head v 27'2424, mlcod=27'2422)", 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.692101+0000", 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00016798400000000001, 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00061911599999999996, 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692101+0000", 2024-09-12T21:51:09.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692101+0000", 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692102+0000", 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5299999999999999e-07 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:09.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692178+0000", 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6212999999999997e-05 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692187+0000", 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6659999999999997e-06 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692192+0000", 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4260000000000002e-06 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692244+0000", 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1539000000000002e-05 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.692260+0000", 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5722999999999998e-05 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 8 2024-09-12T21:51:09.727 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:09.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:09.761 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:09.760+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:09.862 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:09.861+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:09.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:09.912 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:09.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:09.963 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:09.962+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:09.999 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:09.999 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:10.018 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:10.018 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:10.036 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:10.036 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:10.064 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.063+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.067 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.067 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.080 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:10.165 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.165+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.232 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.232 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:10.266 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:10.265+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:10.273 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T21:51:10.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T21:51:10.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 11 16 39390 39374 223.697 176.188 0.00941336 0.00446701 2024-09-12T21:51:10.366 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.365+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.397 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.397 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:10.467 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:10.466+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:10.561 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.561 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.567 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.567+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:10.668 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.668+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.706 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.707 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:10.769 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:10.768+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:10.853 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:10.853 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:10.864 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:10.870 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:10.870+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:10.971 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:10.970+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.010 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.010 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:11.072 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.071+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.164 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.164 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.173 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.171+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T21:51:11.273 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.272+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T21:51:11.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:51:11.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:51:11.320 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.320 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:11.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 12 16 42119 42103 219.268 170.562 0.00473307 0.00455762 2024-09-12T21:51:11.375 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.373+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.463 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.463 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:11.475 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.474+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.575 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:11.574+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:11.612 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:51:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:51:11.619 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.619 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.623 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-12T21:51:11.272554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2302217117,"num_objects":35146,"num_object_clones":0,"num_object_copies":70292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35146,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":35370,"num_write_kb":2251156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35319,"ondisk_log_size":35319,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":4582928,"kb_used_data":4406112,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":278532592,"statfs":{"total":289910292480,"available":285217374208,"internally_reserved":0,"allocated":4511858688,"data_stored":4511320831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1028390912,"num_objects":15692,"num_object_clones":0,"num_object_copies":31384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15692,"num_write_kb":1004288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.007678"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268989+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:51:06.268989+0000","last_peered":"2024-09-12T21:51:06.268989+0000","last_clean":"2024-09-12T21:51:06.268989+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:51:06.268989+0000","last_undegraded":"2024-09-12T21:51:06.268989+0000","last_fullsized":"2024-09-12T21:51:06.268989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268686+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:51:06.268686+0000","last_peered":"2024-09-12T21:51:06.268686+0000","last_clean":"2024-09-12T21:51:06.268686+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:51:06.268686+0000","last_undegraded":"2024-09-12T21:51:06.268686+0000","last_fullsized":"2024-09-12T21:51:06.268686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268559+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:51:06.268559+0000","last_peered":"2024-09-12T21:51:06.268559+0000","last_clean":"2024-09-12T21:51:06.268559+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:51:06.268559+0000","last_undegraded":"2024-09-12T21:51:06.268559+0000","last_fullsized":"2024-09-12T21:51:06.268559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268618+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:51:06.268618+0000","last_peered":"2024-09-12T21:51:06.268618+0000","last_clean":"2024-09-12T21:51:06.268618+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:51:06.268618+0000","last_undegraded":"2024-09-12T21:51:06.268618+0000","last_fullsized":"2024-09-12T21:51:06.268618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268474+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:51:06.268474+0000","last_peered":"2024-09-12T21:51:06.268474+0000","last_clean":"2024-09-12T21:51:06.268474+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:51:06.268474+0000","last_undegraded":"2024-09-12T21:51:06.268474+0000","last_fullsized":"2024-09-12T21:51:06.268474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267950+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:51:06.267950+0000","last_peered":"2024-09-12T21:51:06.267950+0000","last_clean":"2024-09-12T21:51:06.267950+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:51:06.267950+0000","last_undegraded":"2024-09-12T21:51:06.267950+0000","last_fullsized":"2024-09-12T21:51:06.267950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268275+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:51:06.268275+0000","last_peered":"2024-09-12T21:51:06.268275+0000","last_clean":"2024-09-12T21:51:06.268275+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:51:06.268275+0000","last_undegraded":"2024-09-12T21:51:06.268275+0000","last_fullsized":"2024-09-12T21:51:06.268275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267482+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:51:06.267482+0000","last_peered":"2024-09-12T21:51:06.267482+0000","last_clean":"2024-09-12T21:51:06.267482+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:51:06.267482+0000","last_undegraded":"2024-09-12T21:51:06.267482+0000","last_fullsized":"2024-09-12T21:51:06.267482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267569+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:51:06.267569+0000","last_peered":"2024-09-12T21:51:06.267569+0000","last_clean":"2024-09-12T21:51:06.267569+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:51:06.267569+0000","last_undegraded":"2024-09-12T21:51:06.267569+0000","last_fullsized":"2024-09-12T21:51:06.267569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268855+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:51:06.268855+0000","last_peered":"2024-09-12T21:51:06.268855+0000","last_clean":"2024-09-12T21:51:06.268855+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:51:06.268855+0000","last_undegraded":"2024-09-12T21:51:06.268855+0000","last_fullsized":"2024-09-12T21:51:06.268855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268638+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:51:06.268638+0000","last_peered":"2024-09-12T21:51:06.268638+0000","last_clean":"2024-09-12T21:51:06.268638+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:51:06.268638+0000","last_undegraded":"2024-09-12T21:51:06.268638+0000","last_fullsized":"2024-09-12T21:51:06.268638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268117+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:51:06.268117+0000","last_peered":"2024-09-12T21:51:06.268117+0000","last_clean":"2024-09-12T21:51:06.268117+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:51:06.268117+0000","last_undegraded":"2024-09-12T21:51:06.268117+0000","last_fullsized":"2024-09-12T21:51:06.268117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268394+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:51:06.268394+0000","last_peered":"2024-09-12T21:51:06.268394+0000","last_clean":"2024-09-12T21:51:06.268394+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:51:06.268394+0000","last_undegraded":"2024-09-12T21:51:06.268394+0000","last_fullsized":"2024-09-12T21:51:06.268394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267980+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:51:06.267980+0000","last_peered":"2024-09-12T21:51:06.267980+0000","last_clean":"2024-09-12T21:51:06.267980+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:51:06.267980+0000","last_undegraded":"2024-09-12T21:51:06.267980+0000","last_fullsized":"2024-09-12T21:51:06.267980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268336+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:51:06.268336+0000","last_peered":"2024-09-12T21:51:06.268336+0000","last_clean":"2024-09-12T21:51:06.268336+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:51:06.268336+0000","last_undegraded":"2024-09-12T21:51:06.268336+0000","last_fullsized":"2024-09-12T21:51:06.268336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267527+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:51:06.267527+0000","last_peered":"2024-09-12T21:51:06.267527+0000","last_clean":"2024-09-12T21:51:06.267527+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:51:06.267527+0000","last_undegraded":"2024-09-12T21:51:06.267527+0000","last_fullsized":"2024-09-12T21:51:06.267527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268200+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:51:06.268200+0000","last_peered":"2024-09-12T21:51:06.268200+0000","last_clean":"2024-09-12T21:51:06.268200+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:51:06.268200+0000","last_undegraded":"2024-09-12T21:51:06.268200+0000","last_fullsized":"2024-09-12T21:51:06.268200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269054+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:51:06.269054+0000","last_peered":"2024-09-12T21:51:06.269054+0000","last_clean":"2024-09-12T21:51:06.269054+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:51:06.269054+0000","last_undegraded":"2024-09-12T21:51:06.269054+0000","last_fullsized":"2024-09-12T21:51:06.269054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267583+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:51:06.267583+0000","last_peered":"2024-09-12T21:51:06.267583+0000","last_clean":"2024-09-12T21:51:06.267583+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:51:06.267583+0000","last_undegraded":"2024-09-12T21:51:06.267583+0000","last_fullsized":"2024-09-12T21:51:06.267583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268699+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:51:06.268699+0000","last_peered":"2024-09-12T21:51:06.268699+0000","last_clean":"2024-09-12T21:51:06.268699+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:51:06.268699+0000","last_undegraded":"2024-09-12T21:51:06.268699+0000","last_fullsized":"2024-09-12T21:51:06.268699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267830+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:51:06.267830+0000","last_peered":"2024-09-12T21:51:06.267830+0000","last_clean":"2024-09-12T21:51:06.267830+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:51:06.267830+0000","last_undegraded":"2024-09-12T21:51:06.267830+0000","last_fullsized":"2024-09-12T21:51:06.267830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267936+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:51:06.267936+0000","last_peered":"2024-09-12T21:51:06.267936+0000","last_clean":"2024-09-12T21:51:06.267936+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:51:06.267936+0000","last_undegraded":"2024-09-12T21:51:06.267936+0000","last_fullsized":"2024-09-12T21:51:06.267936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267120+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:51:06.267120+0000","last_peered":"2024-09-12T21:51:06.267120+0000","last_clean":"2024-09-12T21:51:06.267120+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:51:06.267120+0000","last_undegraded":"2024-09-12T21:51:06.267120+0000","last_fullsized":"2024-09-12T21:51:06.267120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269085+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:51:06.269085+0000","last_peered":"2024-09-12T21:51:06.269085+0000","last_clean":"2024-09-12T21:51:06.269085+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:51:06.269085+0000","last_undegraded":"2024-09-12T21:51:06.269085+0000","last_fullsized":"2024-09-12T21:51:06.269085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269031+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:51:06.269031+0000","last_peered":"2024-09-12T21:51:06.269031+0000","last_clean":"2024-09-12T21:51:06.269031+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:51:06.269031+0000","last_undegraded":"2024-09-12T21:51:06.269031+0000","last_fullsized":"2024-09-12T21:51:06.269031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267805+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:51:06.267805+0000","last_peered":"2024-09-12T21:51:06.267805+0000","last_clean":"2024-09-12T21:51:06.267805+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:51:06.267805+0000","last_undegraded":"2024-09-12T21:51:06.267805+0000","last_fullsized":"2024-09-12T21:51:06.267805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268685+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:51:06.268685+0000","last_peered":"2024-09-12T21:51:06.268685+0000","last_clean":"2024-09-12T21:51:06.268685+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:51:06.268685+0000","last_undegraded":"2024-09-12T21:51:06.268685+0000","last_fullsized":"2024-09-12T21:51:06.268685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268253+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:51:06.268253+0000","last_peered":"2024-09-12T21:51:06.268253+0000","last_clean":"2024-09-12T21:51:06.268253+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:51:06.268253+0000","last_undegraded":"2024-09-12T21:51:06.268253+0000","last_fullsized":"2024-09-12T21:51:06.268253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267760+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:51:06.267760+0000","last_peered":"2024-09-12T21:51:06.267760+0000","last_clean":"2024-09-12T21:51:06.267760+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:51:06.267760+0000","last_undegraded":"2024-09-12T21:51:06.267760+0000","last_fullsized":"2024-09-12T21:51:06.267760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268025+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:51:06.268025+0000","last_peered":"2024-09-12T21:51:06.268025+0000","last_clean":"2024-09-12T21:51:06.268025+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:51:06.268025+0000","last_undegraded":"2024-09-12T21:51:06.268025+0000","last_fullsized":"2024-09-12T21:51:06.268025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267138+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:51:06.267138+0000","last_peered":"2024-09-12T21:51:06.267138+0000","last_clean":"2024-09-12T21:51:06.267138+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:51:06.267138+0000","last_undegraded":"2024-09-12T21:51:06.267138+0000","last_fullsized":"2024-09-12T21:51:06.267138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267581+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:51:06.267581+0000","last_peered":"2024-09-12T21:51:06.267581+0000","last_clean":"2024-09-12T21:51:06.267581+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:51:06.267581+0000","last_undegraded":"2024-09-12T21:51:06.267581+0000","last_fullsized":"2024-09-12T21:51:06.267581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268232+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:51:06.268232+0000","last_peered":"2024-09-12T21:51:06.268232+0000","last_clean":"2024-09-12T21:51:06.268232+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:51:06.268232+0000","last_undegraded":"2024-09-12T21:51:06.268232+0000","last_fullsized":"2024-09-12T21:51:06.268232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268000+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:51:06.268000+0000","last_peered":"2024-09-12T21:51:06.268000+0000","last_clean":"2024-09-12T21:51:06.268000+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:51:06.268000+0000","last_undegraded":"2024-09-12T21:51:06.268000+0000","last_fullsized":"2024-09-12T21:51:06.268000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268454+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:51:06.268454+0000","last_peered":"2024-09-12T21:51:06.268454+0000","last_clean":"2024-09-12T21:51:06.268454+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:51:06.268454+0000","last_undegraded":"2024-09-12T21:51:06.268454+0000","last_fullsized":"2024-09-12T21:51:06.268454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268563+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:51:06.268563+0000","last_peered":"2024-09-12T21:51:06.268563+0000","last_clean":"2024-09-12T21:51:06.268563+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:51:06.268563+0000","last_undegraded":"2024-09-12T21:51:06.268563+0000","last_fullsized":"2024-09-12T21:51:06.268563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269151+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:51:06.269151+0000","last_peered":"2024-09-12T21:51:06.269151+0000","last_clean":"2024-09-12T21:51:06.269151+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:51:06.269151+0000","last_undegraded":"2024-09-12T21:51:06.269151+0000","last_fullsized":"2024-09-12T21:51:06.269151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267919+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:51:06.267919+0000","last_peered":"2024-09-12T21:51:06.267919+0000","last_clean":"2024-09-12T21:51:06.267919+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:51:06.267919+0000","last_undegraded":"2024-09-12T21:51:06.267919+0000","last_fullsized":"2024-09-12T21:51:06.267919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267652+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:51:06.267652+0000","last_peered":"2024-09-12T21:51:06.267652+0000","last_clean":"2024-09-12T21:51:06.267652+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:51:06.267652+0000","last_undegraded":"2024-09-12T21:51:06.267652+0000","last_fullsized":"2024-09-12T21:51:06.267652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267700+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:51:06.267700+0000","last_peered":"2024-09-12T21:51:06.267700+0000","last_clean":"2024-09-12T21:51:06.267700+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:51:06.267700+0000","last_undegraded":"2024-09-12T21:51:06.267700+0000","last_fullsized":"2024-09-12T21:51:06.267700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'2178","reported_seq":2196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.854647+0000","last_change":"2024-09-12T21:50:58.245933+0000","last_active":"2024-09-12T21:51:08.854647+0000","last_peered":"2024-09-12T21:51:08.854647+0000","last_clean":"2024-09-12T21:51:08.854647+0000","last_became_active":"2024-09-12T21:50:58.245678+0000","last_became_peered":"2024-09-12T21:50:58.245678+0000","last_unstale":"2024-09-12T21:51:08.854647+0000","last_undegraded":"2024-09-12T21:51:08.854647+0000","last_fullsized":"2024-09-12T21:51:08.854647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2178,"log_dups_size":0,"ondisk_log_size":2178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:53.667422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142737408,"num_objects":2178,"num_object_clones":0,"num_object_copies":4356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2178,"num_write_kb":139392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269241+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:51:06.269241+0000","last_peered":"2024-09-12T21:51:06.269241+0000","last_clean":"2024-09-12T21:51:06.269241+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:51:06.269241+0000","last_undegraded":"2024-09-12T21:51:06.269241+0000","last_fullsized":"2024-09-12T21:51:06.269241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269238+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:51:06.269238+0000","last_peered":"2024-09-12T21:51:06.269238+0000","last_clean":"2024-09-12T21:51:06.269238+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:51:06.269238+0000","last_undegraded":"2024-09-12T21:51:06.269238+0000","last_fullsized":"2024-09-12T21:51:06.269238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'2260","reported_seq":2278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863517+0000","last_change":"2024-09-12T21:50:58.246155+0000","last_active":"2024-09-12T21:51:08.863517+0000","last_peered":"2024-09-12T21:51:08.863517+0000","last_clean":"2024-09-12T21:51:08.863517+0000","last_became_active":"2024-09-12T21:50:58.245921+0000","last_became_peered":"2024-09-12T21:50:58.245921+0000","last_unstale":"2024-09-12T21:51:08.863517+0000","last_undegraded":"2024-09-12T21:51:08.863517+0000","last_fullsized":"2024-09-12T21:51:08.863517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:45.277951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148111360,"num_objects":2260,"num_object_clones":0,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2260,"num_write_kb":144640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269087+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:51:06.269087+0000","last_peered":"2024-09-12T21:51:06.269087+0000","last_clean":"2024-09-12T21:51:06.269087+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:51:06.269087+0000","last_undegraded":"2024-09-12T21:51:06.269087+0000","last_fullsized":"2024-09-12T21:51:06.269087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267791+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:51:06.267791+0000","last_peered":"2024-09-12T21:51:06.267791+0000","last_clean":"2024-09-12T21:51:06.267791+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:51:06.267791+0000","last_undegraded":"2024-09-12T21:51:06.267791+0000","last_fullsized":"2024-09-12T21:51:06.267791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"26'2121","reported_seq":2139,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.856898+0000","last_change":"2024-09-12T21:50:58.247516+0000","last_active":"2024-09-12T21:51:08.856898+0000","last_peered":"2024-09-12T21:51:08.856898+0000","last_clean":"2024-09-12T21:51:08.856898+0000","last_became_active":"2024-09-12T21:50:58.247295+0000","last_became_peered":"2024-09-12T21:50:58.247295+0000","last_unstale":"2024-09-12T21:51:08.856898+0000","last_undegraded":"2024-09-12T21:51:08.856898+0000","last_fullsized":"2024-09-12T21:51:08.856898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:24.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139001856,"num_objects":2121,"num_object_clones":0,"num_object_copies":4242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2121,"num_write_kb":135744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268850+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:51:06.268850+0000","last_peered":"2024-09-12T21:51:06.268850+0000","last_clean":"2024-09-12T21:51:06.268850+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:51:06.268850+0000","last_undegraded":"2024-09-12T21:51:06.268850+0000","last_fullsized":"2024-09-12T21:51:06.268850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268096+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:51:06.268096+0000","last_peered":"2024-09-12T21:51:06.268096+0000","last_clean":"2024-09-12T21:51:06.268096+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:51:06.268096+0000","last_undegraded":"2024-09-12T21:51:06.268096+0000","last_fullsized":"2024-09-12T21:51:06.268096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"26'2162","reported_seq":2180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863370+0000","last_change":"2024-09-12T21:50:58.246517+0000","last_active":"2024-09-12T21:51:08.863370+0000","last_peered":"2024-09-12T21:51:08.863370+0000","last_clean":"2024-09-12T21:51:08.863370+0000","last_became_active":"2024-09-12T21:50:58.246253+0000","last_became_peered":"2024-09-12T21:50:58.246253+0000","last_unstale":"2024-09-12T21:51:08.863370+0000","last_undegraded":"2024-09-12T21:51:08.863370+0000","last_fullsized":"2024-09-12T21:51:08.863370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:45.277951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141688832,"num_objects":2162,"num_object_clones":0,"num_object_copies":4324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2162,"num_write_kb":138368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269033+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:51:06.269033+0000","last_peered":"2024-09-12T21:51:06.269033+0000","last_clean":"2024-09-12T21:51:06.269033+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:51:06.269033+0000","last_undegraded":"2024-09-12T21:51:06.269033+0000","last_fullsized":"2024-09-12T21:51:06.269033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267987+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:51:06.267987+0000","last_peered":"2024-09-12T21:51:06.267987+0000","last_clean":"2024-09-12T21:51:06.267987+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:51:06.267987+0000","last_undegraded":"2024-09-12T21:51:06.267987+0000","last_fullsized":"2024-09-12T21:51:06.267987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"26'2207","reported_seq":2225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863322+0000","last_change":"2024-09-12T21:50:58.251593+0000","last_active":"2024-09-12T21:51:08.863322+0000","last_peered":"2024-09-12T21:51:08.863322+0000","last_clean":"2024-09-12T21:51:08.863322+0000","last_became_active":"2024-09-12T21:50:58.251353+0000","last_became_peered":"2024-09-12T21:50:58.251353+0000","last_unstale":"2024-09-12T21:51:08.863322+0000","last_undegraded":"2024-09-12T21:51:08.863322+0000","last_fullsized":"2024-09-12T21:51:08.863322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2207,"log_dups_size":0,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.153155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":4414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268164+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:51:06.268164+0000","last_peered":"2024-09-12T21:51:06.268164+0000","last_clean":"2024-09-12T21:51:06.268164+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:51:06.268164+0000","last_undegraded":"2024-09-12T21:51:06.268164+0000","last_fullsized":"2024-09-12T21:51:06.268164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268775+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:51:06.268775+0000","last_peered":"2024-09-12T21:51:06.268775+0000","last_clean":"2024-09-12T21:51:06.268775+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:51:06.268775+0000","last_undegraded":"2024-09-12T21:51:06.268775+0000","last_fullsized":"2024-09-12T21:51:06.268775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"26'2090","reported_seq":2108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870144+0000","last_change":"2024-09-12T21:50:58.251553+0000","last_active":"2024-09-12T21:51:08.870144+0000","last_peered":"2024-09-12T21:51:08.870144+0000","last_clean":"2024-09-12T21:51:08.870144+0000","last_became_active":"2024-09-12T21:50:58.251247+0000","last_became_peered":"2024-09-12T21:50:58.251247+0000","last_unstale":"2024-09-12T21:51:08.870144+0000","last_undegraded":"2024-09-12T21:51:08.870144+0000","last_fullsized":"2024-09-12T21:51:08.870144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2090,"log_dups_size":0,"ondisk_log_size":2090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:24.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136970240,"num_objects":2090,"num_object_clones":0,"num_object_copies":4180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2090,"num_write_kb":133760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268154+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:51:06.268154+0000","last_peered":"2024-09-12T21:51:06.268154+0000","last_clean":"2024-09-12T21:51:06.268154+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:51:06.268154+0000","last_undegraded":"2024-09-12T21:51:06.268154+0000","last_fullsized":"2024-09-12T21:51:06.268154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268769+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:51:06.268769+0000","last_peered":"2024-09-12T21:51:06.268769+0000","last_clean":"2024-09-12T21:51:06.268769+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:51:06.268769+0000","last_undegraded":"2024-09-12T21:51:06.268769+0000","last_fullsized":"2024-09-12T21:51:06.268769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"26'2200","reported_seq":2218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.869207+0000","last_change":"2024-09-12T21:50:58.245944+0000","last_active":"2024-09-12T21:51:08.869207+0000","last_peered":"2024-09-12T21:51:08.869207+0000","last_clean":"2024-09-12T21:51:08.869207+0000","last_became_active":"2024-09-12T21:50:58.245687+0000","last_became_peered":"2024-09-12T21:50:58.245687+0000","last_unstale":"2024-09-12T21:51:08.869207+0000","last_undegraded":"2024-09-12T21:51:08.869207+0000","last_fullsized":"2024-09-12T21:51:08.869207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2200,"log_dups_size":0,"ondisk_log_size":2200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.777355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144179200,"num_objects":2200,"num_object_clones":0,"num_object_copies":4400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2200,"num_write_kb":140800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267988+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:51:06.267988+0000","last_peered":"2024-09-12T21:51:06.267988+0000","last_clean":"2024-09-12T21:51:06.267988+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:51:06.267988+0000","last_undegraded":"2024-09-12T21:51:06.267988+0000","last_fullsized":"2024-09-12T21:51:06.267988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268715+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:51:06.268715+0000","last_peered":"2024-09-12T21:51:06.268715+0000","last_clean":"2024-09-12T21:51:06.268715+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:51:06.268715+0000","last_undegraded":"2024-09-12T21:51:06.268715+0000","last_fullsized":"2024-09-12T21:51:06.268715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"26'2252","reported_seq":2270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858255+0000","last_change":"2024-09-12T21:50:58.247657+0000","last_active":"2024-09-12T21:51:08.858255+0000","last_peered":"2024-09-12T21:51:08.858255+0000","last_clean":"2024-09-12T21:51:08.858255+0000","last_became_active":"2024-09-12T21:50:58.247417+0000","last_became_peered":"2024-09-12T21:50:58.247417+0000","last_unstale":"2024-09-12T21:51:08.858255+0000","last_undegraded":"2024-09-12T21:51:08.858255+0000","last_fullsized":"2024-09-12T21:51:08.858255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:54.350208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147587072,"num_objects":2252,"num_object_clones":0,"num_object_copies":4504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2252,"num_write_kb":144128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269319+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:51:06.269319+0000","last_peered":"2024-09-12T21:51:06.269319+0000","last_clean":"2024-09-12T21:51:06.269319+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:51:06.269319+0000","last_undegraded":"2024-09-12T21:51:06.269319+0000","last_fullsized":"2024-09-12T21:51:06.269319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267713+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:51:06.267713+0000","last_peered":"2024-09-12T21:51:06.267713+0000","last_clean":"2024-09-12T21:51:06.267713+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:51:06.267713+0000","last_undegraded":"2024-09-12T21:51:06.267713+0000","last_fullsized":"2024-09-12T21:51:06.267713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"26'2201","reported_seq":2219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858903+0000","last_change":"2024-09-12T21:50:58.247583+0000","last_active":"2024-09-12T21:51:08.858903+0000","last_peered":"2024-09-12T21:51:08.858903+0000","last_clean":"2024-09-12T21:51:08.858903+0000","last_became_active":"2024-09-12T21:50:58.247340+0000","last_became_peered":"2024-09-12T21:50:58.247340+0000","last_unstale":"2024-09-12T21:51:08.858903+0000","last_undegraded":"2024-09-12T21:51:08.858903+0000","last_fullsized":"2024-09-12T21:51:08.858903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2201,"log_dups_size":0,"ondisk_log_size":2201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.602801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144244736,"num_objects":2201,"num_object_clones":0,"num_object_copies":4402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":140864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267883+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:51:06.267883+0000","last_peered":"2024-09-12T21:51:06.267883+0000","last_clean":"2024-09-12T21:51:06.267883+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:51:06.267883+0000","last_undegraded":"2024-09-12T21:51:06.267883+0000","last_fullsized":"2024-09-12T21:51:06.267883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268098+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:51:06.268098+0000","last_peered":"2024-09-12T21:51:06.268098+0000","last_clean":"2024-09-12T21:51:06.268098+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:51:06.268098+0000","last_undegraded":"2024-09-12T21:51:06.268098+0000","last_fullsized":"2024-09-12T21:51:06.268098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268646+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:51:06.268646+0000","last_peered":"2024-09-12T21:51:06.268646+0000","last_clean":"2024-09-12T21:51:06.268646+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:51:06.268646+0000","last_undegraded":"2024-09-12T21:51:06.268646+0000","last_fullsized":"2024-09-12T21:51:06.268646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268826+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:51:06.268826+0000","last_peered":"2024-09-12T21:51:06.268826+0000","last_clean":"2024-09-12T21:51:06.268826+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:51:06.268826+0000","last_undegraded":"2024-09-12T21:51:06.268826+0000","last_fullsized":"2024-09-12T21:51:06.268826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'2195","reported_seq":2209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870186+0000","last_change":"2024-09-12T21:50:58.246826+0000","last_active":"2024-09-12T21:51:08.870186+0000","last_peered":"2024-09-12T21:51:08.870186+0000","last_clean":"2024-09-12T21:51:08.870186+0000","last_became_active":"2024-09-12T21:50:58.246661+0000","last_became_peered":"2024-09-12T21:50:58.246661+0000","last_unstale":"2024-09-12T21:51:08.870186+0000","last_undegraded":"2024-09-12T21:51:08.870186+0000","last_fullsized":"2024-09-12T21:51:08.870186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.282947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143851520,"num_objects":2195,"num_object_clones":0,"num_object_copies":4390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2195,"num_write_kb":140480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267802+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:51:06.267802+0000","last_peered":"2024-09-12T21:51:06.267802+0000","last_clean":"2024-09-12T21:51:06.267802+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:51:06.267802+0000","last_undegraded":"2024-09-12T21:51:06.267802+0000","last_fullsized":"2024-09-12T21:51:06.267802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267432+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:51:06.267432+0000","last_peered":"2024-09-12T21:51:06.267432+0000","last_clean":"2024-09-12T21:51:06.267432+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:51:06.267432+0000","last_undegraded":"2024-09-12T21:51:06.267432+0000","last_fullsized":"2024-09-12T21:51:06.267432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268973+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:51:06.268973+0000","last_peered":"2024-09-12T21:51:06.268973+0000","last_clean":"2024-09-12T21:51:06.268973+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:51:06.268973+0000","last_undegraded":"2024-09-12T21:51:06.268973+0000","last_fullsized":"2024-09-12T21:51:06.268973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"26'2207","reported_seq":2225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.869780+0000","last_change":"2024-09-12T21:50:58.251551+0000","last_active":"2024-09-12T21:51:08.869780+0000","last_peered":"2024-09-12T21:51:08.869780+0000","last_clean":"2024-09-12T21:51:08.869780+0000","last_became_active":"2024-09-12T21:50:58.251281+0000","last_became_peered":"2024-09-12T21:50:58.251281+0000","last_unstale":"2024-09-12T21:51:08.869780+0000","last_undegraded":"2024-09-12T21:51:08.869780+0000","last_fullsized":"2024-09-12T21:51:08.869780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2207,"log_dups_size":0,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.153155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":4414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267540+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:51:06.267540+0000","last_peered":"2024-09-12T21:51:06.267540+0000","last_clean":"2024-09-12T21:51:06.267540+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:51:06.267540+0000","last_undegraded":"2024-09-12T21:51:06.267540+0000","last_fullsized":"2024-09-12T21:51:06.267540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269405+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:51:06.269405+0000","last_peered":"2024-09-12T21:51:06.269405+0000","last_clean":"2024-09-12T21:51:06.269405+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:51:06.269405+0000","last_undegraded":"2024-09-12T21:51:06.269405+0000","last_fullsized":"2024-09-12T21:51:06.269405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267733+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:51:06.267733+0000","last_peered":"2024-09-12T21:51:06.267733+0000","last_clean":"2024-09-12T21:51:06.267733+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:51:06.267733+0000","last_undegraded":"2024-09-12T21:51:06.267733+0000","last_fullsized":"2024-09-12T21:51:06.267733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'2196","reported_seq":2214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.864128+0000","last_change":"2024-09-12T21:50:58.251500+0000","last_active":"2024-09-12T21:51:08.864128+0000","last_peered":"2024-09-12T21:51:08.864128+0000","last_clean":"2024-09-12T21:51:08.864128+0000","last_became_active":"2024-09-12T21:50:58.251206+0000","last_became_peered":"2024-09-12T21:50:58.251206+0000","last_unstale":"2024-09-12T21:51:08.864128+0000","last_undegraded":"2024-09-12T21:51:08.864128+0000","last_fullsized":"2024-09-12T21:51:08.864128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2196,"log_dups_size":0,"ondisk_log_size":2196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.602801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143917056,"num_objects":2196,"num_object_clones":0,"num_object_copies":4392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2196,"num_write_kb":140544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268232+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:51:06.268232+0000","last_peered":"2024-09-12T21:51:06.268232+0000","last_clean":"2024-09-12T21:51:06.268232+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:51:06.268232+0000","last_undegraded":"2024-09-12T21:51:06.268232+0000","last_fullsized":"2024-09-12T21:51:06.268232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268052+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:51:06.268052+0000","last_peered":"2024-09-12T21:51:06.268052+0000","last_clean":"2024-09-12T21:51:06.268052+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:51:06.268052+0000","last_undegraded":"2024-09-12T21:51:06.268052+0000","last_fullsized":"2024-09-12T21:51:06.268052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268511+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:51:06.268511+0000","last_peered":"2024-09-12T21:51:06.268511+0000","last_clean":"2024-09-12T21:51:06.268511+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:51:06.268511+0000","last_undegraded":"2024-09-12T21:51:06.268511+0000","last_fullsized":"2024-09-12T21:51:06.268511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'2287","reported_seq":2305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863408+0000","last_change":"2024-09-12T21:50:58.251572+0000","last_active":"2024-09-12T21:51:08.863408+0000","last_peered":"2024-09-12T21:51:08.863408+0000","last_clean":"2024-09-12T21:51:08.863408+0000","last_became_active":"2024-09-12T21:50:58.251291+0000","last_became_peered":"2024-09-12T21:50:58.251291+0000","last_unstale":"2024-09-12T21:51:08.863408+0000","last_undegraded":"2024-09-12T21:51:08.863408+0000","last_fullsized":"2024-09-12T21:51:08.863408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:44.155310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149880832,"num_objects":2287,"num_object_clones":0,"num_object_copies":4574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2287,"num_write_kb":146368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268919+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:51:06.268919+0000","last_peered":"2024-09-12T21:51:06.268919+0000","last_clean":"2024-09-12T21:51:06.268919+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:51:06.268919+0000","last_undegraded":"2024-09-12T21:51:06.268919+0000","last_fullsized":"2024-09-12T21:51:06.268919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268667+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:51:06.268667+0000","last_peered":"2024-09-12T21:51:06.268667+0000","last_clean":"2024-09-12T21:51:06.268667+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:51:06.268667+0000","last_undegraded":"2024-09-12T21:51:06.268667+0000","last_fullsized":"2024-09-12T21:51:06.268667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267941+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:51:06.267941+0000","last_peered":"2024-09-12T21:51:06.267941+0000","last_clean":"2024-09-12T21:51:06.267941+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:51:06.267941+0000","last_undegraded":"2024-09-12T21:51:06.267941+0000","last_fullsized":"2024-09-12T21:51:06.267941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"26'2223","reported_seq":2241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.851100+0000","last_change":"2024-09-12T21:50:58.247553+0000","last_active":"2024-09-12T21:51:08.851100+0000","last_peered":"2024-09-12T21:51:08.851100+0000","last_clean":"2024-09-12T21:51:08.851100+0000","last_became_active":"2024-09-12T21:50:58.247363+0000","last_became_peered":"2024-09-12T21:50:58.247363+0000","last_unstale":"2024-09-12T21:51:08.851100+0000","last_undegraded":"2024-09-12T21:51:08.851100+0000","last_fullsized":"2024-09-12T21:51:08.851100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:59.192092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145686528,"num_objects":2223,"num_object_clones":0,"num_object_copies":4446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2223,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268593+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:51:06.268593+0000","last_peered":"2024-09-12T21:51:06.268593+0000","last_clean":"2024-09-12T21:51:06.268593+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:51:06.268593+0000","last_undegraded":"2024-09-12T21:51:06.268593+0000","last_fullsized":"2024-09-12T21:51:06.268593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268797+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:51:06.268797+0000","last_peered":"2024-09-12T21:51:06.268797+0000","last_clean":"2024-09-12T21:51:06.268797+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:51:06.268797+0000","last_undegraded":"2024-09-12T21:51:06.268797+0000","last_fullsized":"2024-09-12T21:51:06.268797+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268413+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:51:06.268413+0000","last_peered":"2024-09-12T21:51:06.268413+0000","last_clean":"2024-09-12T21:51:06.268413+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:51:06.268413+0000","last_undegraded":"2024-09-12T21:51:06.268413+0000","last_fullsized":"2024-09-12T21:51:06.268413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"26'2146","reported_seq":2164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870109+0000","last_change":"2024-09-12T21:50:58.246163+0000","last_active":"2024-09-12T21:51:08.870109+0000","last_peered":"2024-09-12T21:51:08.870109+0000","last_clean":"2024-09-12T21:51:08.870109+0000","last_became_active":"2024-09-12T21:50:58.245866+0000","last_became_peered":"2024-09-12T21:50:58.245866+0000","last_unstale":"2024-09-12T21:51:08.870109+0000","last_undegraded":"2024-09-12T21:51:08.870109+0000","last_fullsized":"2024-09-12T21:51:08.870109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:39.661924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140640256,"num_objects":2146,"num_object_clones":0,"num_object_copies":4292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2146,"num_write_kb":137344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268284+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:51:06.268284+0000","last_peered":"2024-09-12T21:51:06.268284+0000","last_clean":"2024-09-12T21:51:06.268284+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:51:06.268284+0000","last_undegraded":"2024-09-12T21:51:06.268284+0000","last_fullsized":"2024-09-12T21:51:06.268284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269288+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:51:06.269288+0000","last_peered":"2024-09-12T21:51:06.269288+0000","last_clean":"2024-09-12T21:51:06.269288+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:51:06.269288+0000","last_undegraded":"2024-09-12T21:51:06.269288+0000","last_fullsized":"2024-09-12T21:51:06.269288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267489+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:51:06.267489+0000","last_peered":"2024-09-12T21:51:06.267489+0000","last_clean":"2024-09-12T21:51:06.267489+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:51:06.267489+0000","last_undegraded":"2024-09-12T21:51:06.267489+0000","last_fullsized":"2024-09-12T21:51:06.267489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"26'2195","reported_seq":2212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858170+0000","last_change":"2024-09-12T21:50:58.247690+0000","last_active":"2024-09-12T21:51:08.858170+0000","last_peered":"2024-09-12T21:51:08.858170+0000","last_clean":"2024-09-12T21:51:08.858170+0000","last_became_active":"2024-09-12T21:50:58.247399+0000","last_became_peered":"2024-09-12T21:50:58.247399+0000","last_unstale":"2024-09-12T21:51:08.858170+0000","last_undegraded":"2024-09-12T21:51:08.858170+0000","last_fullsized":"2024-09-12T21:51:08.858170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:44.155310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143851520,"num_objects":2195,"num_object_clones":0,"num_object_copies":4390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2195,"num_write_kb":140480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269198+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:51:06.269198+0000","last_peered":"2024-09-12T21:51:06.269198+0000","last_clean":"2024-09-12T21:51:06.269198+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:51:06.269198+0000","last_undegraded":"2024-09-12T21:51:06.269198+0000","last_fullsized":"2024-09-12T21:51:06.269198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269294+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:51:06.269294+0000","last_peered":"2024-09-12T21:51:06.269294+0000","last_clean":"2024-09-12T21:51:06.269294+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:51:06.269294+0000","last_undegraded":"2024-09-12T21:51:06.269294+0000","last_fullsized":"2024-09-12T21:51:06.269294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267792+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:51:06.267792+0000","last_peered":"2024-09-12T21:51:06.267792+0000","last_clean":"2024-09-12T21:51:06.267792+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:51:06.267792+0000","last_undegraded":"2024-09-12T21:51:06.267792+0000","last_fullsized":"2024-09-12T21:51:06.267792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267948+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:51:06.267948+0000","last_peered":"2024-09-12T21:51:06.267948+0000","last_clean":"2024-09-12T21:51:06.267948+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:51:06.267948+0000","last_undegraded":"2024-09-12T21:51:06.267948+0000","last_fullsized":"2024-09-12T21:51:06.267948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268945+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:51:06.268945+0000","last_peered":"2024-09-12T21:51:06.268945+0000","last_clean":"2024-09-12T21:51:06.268945+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:51:06.268945+0000","last_undegraded":"2024-09-12T21:51:06.268945+0000","last_fullsized":"2024-09-12T21:51:06.268945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268464+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:51:06.268464+0000","last_peered":"2024-09-12T21:51:06.268464+0000","last_clean":"2024-09-12T21:51:06.268464+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:51:06.268464+0000","last_undegraded":"2024-09-12T21:51:06.268464+0000","last_fullsized":"2024-09-12T21:51:06.268464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268733+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:51:06.268733+0000","last_peered":"2024-09-12T21:51:06.268733+0000","last_clean":"2024-09-12T21:51:06.268733+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:51:06.268733+0000","last_undegraded":"2024-09-12T21:51:06.268733+0000","last_fullsized":"2024-09-12T21:51:06.268733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268633+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:51:06.268633+0000","last_peered":"2024-09-12T21:51:06.268633+0000","last_clean":"2024-09-12T21:51:06.268633+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:51:06.268633+0000","last_undegraded":"2024-09-12T21:51:06.268633+0000","last_fullsized":"2024-09-12T21:51:06.268633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267209+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:51:06.267209+0000","last_peered":"2024-09-12T21:51:06.267209+0000","last_clean":"2024-09-12T21:51:06.267209+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:51:06.267209+0000","last_undegraded":"2024-09-12T21:51:06.267209+0000","last_fullsized":"2024-09-12T21:51:06.267209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268194+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:51:06.268194+0000","last_peered":"2024-09-12T21:51:06.268194+0000","last_clean":"2024-09-12T21:51:06.268194+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:51:06.268194+0000","last_undegraded":"2024-09-12T21:51:06.268194+0000","last_fullsized":"2024-09-12T21:51:06.268194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267440+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:51:06.267440+0000","last_peered":"2024-09-12T21:51:06.267440+0000","last_clean":"2024-09-12T21:51:06.267440+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:51:06.267440+0000","last_undegraded":"2024-09-12T21:51:06.267440+0000","last_fullsized":"2024-09-12T21:51:06.267440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269075+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:51:06.269075+0000","last_peered":"2024-09-12T21:51:06.269075+0000","last_clean":"2024-09-12T21:51:06.269075+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:51:06.269075+0000","last_undegraded":"2024-09-12T21:51:06.269075+0000","last_fullsized":"2024-09-12T21:51:06.269075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267536+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:51:06.267536+0000","last_peered":"2024-09-12T21:51:06.267536+0000","last_clean":"2024-09-12T21:51:06.267536+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:51:06.267536+0000","last_undegraded":"2024-09-12T21:51:06.267536+0000","last_fullsized":"2024-09-12T21:51:06.267536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268723+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:51:06.268723+0000","last_peered":"2024-09-12T21:51:06.268723+0000","last_clean":"2024-09-12T21:51:06.268723+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:51:06.268723+0000","last_undegraded":"2024-09-12T21:51:06.268723+0000","last_fullsized":"2024-09-12T21:51:06.268723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267343+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:51:06.267343+0000","last_peered":"2024-09-12T21:51:06.267343+0000","last_clean":"2024-09-12T21:51:06.267343+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:51:06.267343+0000","last_undegraded":"2024-09-12T21:51:06.267343+0000","last_fullsized":"2024-09-12T21:51:06.267343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268349+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:51:06.268349+0000","last_peered":"2024-09-12T21:51:06.268349+0000","last_clean":"2024-09-12T21:51:06.268349+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:51:06.268349+0000","last_undegraded":"2024-09-12T21:51:06.268349+0000","last_fullsized":"2024-09-12T21:51:06.268349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268205+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:51:06.268205+0000","last_peered":"2024-09-12T21:51:06.268205+0000","last_clean":"2024-09-12T21:51:06.268205+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:51:06.268205+0000","last_undegraded":"2024-09-12T21:51:06.268205+0000","last_fullsized":"2024-09-12T21:51:06.268205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268166+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:51:06.268166+0000","last_peered":"2024-09-12T21:51:06.268166+0000","last_clean":"2024-09-12T21:51:06.268166+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:51:06.268166+0000","last_undegraded":"2024-09-12T21:51:06.268166+0000","last_fullsized":"2024-09-12T21:51:06.268166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268493+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:51:06.268493+0000","last_peered":"2024-09-12T21:51:06.268493+0000","last_clean":"2024-09-12T21:51:06.268493+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:51:06.268493+0000","last_undegraded":"2024-09-12T21:51:06.268493+0000","last_fullsized":"2024-09-12T21:51:06.268493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267860+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:51:06.267860+0000","last_peered":"2024-09-12T21:51:06.267860+0000","last_clean":"2024-09-12T21:51:06.267860+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:51:06.267860+0000","last_undegraded":"2024-09-12T21:51:06.267860+0000","last_fullsized":"2024-09-12T21:51:06.267860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268855+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:51:06.268855+0000","last_peered":"2024-09-12T21:51:06.268855+0000","last_clean":"2024-09-12T21:51:06.268855+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:51:06.268855+0000","last_undegraded":"2024-09-12T21:51:06.268855+0000","last_fullsized":"2024-09-12T21:51:06.268855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268096+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:51:06.268096+0000","last_peered":"2024-09-12T21:51:06.268096+0000","last_clean":"2024-09-12T21:51:06.268096+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:51:06.268096+0000","last_undegraded":"2024-09-12T21:51:06.268096+0000","last_fullsized":"2024-09-12T21:51:06.268096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268567+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:51:06.268567+0000","last_peered":"2024-09-12T21:51:06.268567+0000","last_clean":"2024-09-12T21:51:06.268567+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:51:06.268567+0000","last_undegraded":"2024-09-12T21:51:06.268567+0000","last_fullsized":"2024-09-12T21:51:06.268567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268072+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:51:06.268072+0000","last_peered":"2024-09-12T21:51:06.268072+0000","last_clean":"2024-09-12T21:51:06.268072+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:51:06.268072+0000","last_undegraded":"2024-09-12T21:51:06.268072+0000","last_fullsized":"2024-09-12T21:51:06.268072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269071+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:51:06.269071+0000","last_peered":"2024-09-12T21:51:06.269071+0000","last_clean":"2024-09-12T21:51:06.269071+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:51:06.269071+0000","last_undegraded":"2024-09-12T21:51:06.269071+0000","last_fullsized":"2024-09-12T21:51:06.269071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267720+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:51:06.267720+0000","last_peered":"2024-09-12T21:51:06.267720+0000","last_clean":"2024-09-12T21:51:06.267720+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:51:06.267720+0000","last_undegraded":"2024-09-12T21:51:06.267720+0000","last_fullsized":"2024-09-12T21:51:06.267720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268029+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:51:06.268029+0000","last_peered":"2024-09-12T21:51:06.268029+0000","last_clean":"2024-09-12T21:51:06.268029+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:51:06.268029+0000","last_undegraded":"2024-09-12T21:51:06.268029+0000","last_fullsized":"2024-09-12T21:51:06.268029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2301624320,"num_objects":35120,"num_object_clones":0,"num_object_copies":70240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35120,"num_write_kb":2247680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4604428288,"data_stored":4604428288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35120,"ondisk_log_size":35120,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1325532,"kb_used_data":1263820,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":93046308,"statfs":{"total":96636764160,"available":95279419392,"internally_reserved":0,"allocated":1294151680,"data_stored":1293971385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1870028,"kb_used_data":1812476,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92501812,"statfs":{"total":96636764160,"available":94721855488,"internally_reserved":0,"allocated":1855975424,"data_stored":1855809810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1387368,"kb_used_data":1329816,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92984472,"statfs":{"total":96636764160,"available":95216099328,"internally_reserved":0,"allocated":1361731584,"data_stored":1361539636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1437532160,"data_stored":1437532160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1870594048,"data_stored":1870594048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1296302080,"data_stored":1296302080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:51:11.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:51:11.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:11.676 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:11.676+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:11.777 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:11.776+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:11.783 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.783 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:11.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:11.878 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:11.878+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:11.970 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:51:11.971 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:51:11.979 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:11.978+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:11.981 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-12T21:51:11.272554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2302217117,"num_objects":35146,"num_object_clones":0,"num_object_copies":70292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35146,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":35370,"num_write_kb":2251156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35319,"ondisk_log_size":35319,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":4582928,"kb_used_data":4406112,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":278532592,"statfs":{"total":289910292480,"available":285217374208,"internally_reserved":0,"allocated":4511858688,"data_stored":4511320831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1028390912,"num_objects":15692,"num_object_clones":0,"num_object_copies":31384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15692,"num_write_kb":1004288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.007678"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268989+0000","last_change":"2024-09-12T21:50:39.854379+0000","last_active":"2024-09-12T21:51:06.268989+0000","last_peered":"2024-09-12T21:51:06.268989+0000","last_clean":"2024-09-12T21:51:06.268989+0000","last_became_active":"2024-09-12T21:50:39.854102+0000","last_became_peered":"2024-09-12T21:50:39.854102+0000","last_unstale":"2024-09-12T21:51:06.268989+0000","last_undegraded":"2024-09-12T21:51:06.268989+0000","last_fullsized":"2024-09-12T21:51:06.268989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268686+0000","last_change":"2024-09-12T21:50:39.853850+0000","last_active":"2024-09-12T21:51:06.268686+0000","last_peered":"2024-09-12T21:51:06.268686+0000","last_clean":"2024-09-12T21:51:06.268686+0000","last_became_active":"2024-09-12T21:50:39.852663+0000","last_became_peered":"2024-09-12T21:50:39.852663+0000","last_unstale":"2024-09-12T21:51:06.268686+0000","last_undegraded":"2024-09-12T21:51:06.268686+0000","last_fullsized":"2024-09-12T21:51:06.268686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268559+0000","last_change":"2024-09-12T21:50:39.856806+0000","last_active":"2024-09-12T21:51:06.268559+0000","last_peered":"2024-09-12T21:51:06.268559+0000","last_clean":"2024-09-12T21:51:06.268559+0000","last_became_active":"2024-09-12T21:50:39.855040+0000","last_became_peered":"2024-09-12T21:50:39.855040+0000","last_unstale":"2024-09-12T21:51:06.268559+0000","last_undegraded":"2024-09-12T21:51:06.268559+0000","last_fullsized":"2024-09-12T21:51:06.268559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:14.901715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268618+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:51:06.268618+0000","last_peered":"2024-09-12T21:51:06.268618+0000","last_clean":"2024-09-12T21:51:06.268618+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:51:06.268618+0000","last_undegraded":"2024-09-12T21:51:06.268618+0000","last_fullsized":"2024-09-12T21:51:06.268618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268474+0000","last_change":"2024-09-12T21:50:39.853711+0000","last_active":"2024-09-12T21:51:06.268474+0000","last_peered":"2024-09-12T21:51:06.268474+0000","last_clean":"2024-09-12T21:51:06.268474+0000","last_became_active":"2024-09-12T21:50:39.852175+0000","last_became_peered":"2024-09-12T21:50:39.852175+0000","last_unstale":"2024-09-12T21:51:06.268474+0000","last_undegraded":"2024-09-12T21:51:06.268474+0000","last_fullsized":"2024-09-12T21:51:06.268474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267950+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:51:06.267950+0000","last_peered":"2024-09-12T21:51:06.267950+0000","last_clean":"2024-09-12T21:51:06.267950+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:51:06.267950+0000","last_undegraded":"2024-09-12T21:51:06.267950+0000","last_fullsized":"2024-09-12T21:51:06.267950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268275+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:51:06.268275+0000","last_peered":"2024-09-12T21:51:06.268275+0000","last_clean":"2024-09-12T21:51:06.268275+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:51:06.268275+0000","last_undegraded":"2024-09-12T21:51:06.268275+0000","last_fullsized":"2024-09-12T21:51:06.268275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267482+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:51:06.267482+0000","last_peered":"2024-09-12T21:51:06.267482+0000","last_clean":"2024-09-12T21:51:06.267482+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:51:06.267482+0000","last_undegraded":"2024-09-12T21:51:06.267482+0000","last_fullsized":"2024-09-12T21:51:06.267482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267569+0000","last_change":"2024-09-12T21:50:39.856709+0000","last_active":"2024-09-12T21:51:06.267569+0000","last_peered":"2024-09-12T21:51:06.267569+0000","last_clean":"2024-09-12T21:51:06.267569+0000","last_became_active":"2024-09-12T21:50:39.856150+0000","last_became_peered":"2024-09-12T21:50:39.856150+0000","last_unstale":"2024-09-12T21:51:06.267569+0000","last_undegraded":"2024-09-12T21:51:06.267569+0000","last_fullsized":"2024-09-12T21:51:06.267569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268855+0000","last_change":"2024-09-12T21:50:39.854916+0000","last_active":"2024-09-12T21:51:06.268855+0000","last_peered":"2024-09-12T21:51:06.268855+0000","last_clean":"2024-09-12T21:51:06.268855+0000","last_became_active":"2024-09-12T21:50:39.852943+0000","last_became_peered":"2024-09-12T21:50:39.852943+0000","last_unstale":"2024-09-12T21:51:06.268855+0000","last_undegraded":"2024-09-12T21:51:06.268855+0000","last_fullsized":"2024-09-12T21:51:06.268855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268638+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:51:06.268638+0000","last_peered":"2024-09-12T21:51:06.268638+0000","last_clean":"2024-09-12T21:51:06.268638+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:51:06.268638+0000","last_undegraded":"2024-09-12T21:51:06.268638+0000","last_fullsized":"2024-09-12T21:51:06.268638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268117+0000","last_change":"2024-09-12T21:50:39.856328+0000","last_active":"2024-09-12T21:51:06.268117+0000","last_peered":"2024-09-12T21:51:06.268117+0000","last_clean":"2024-09-12T21:51:06.268117+0000","last_became_active":"2024-09-12T21:50:39.855983+0000","last_became_peered":"2024-09-12T21:50:39.855983+0000","last_unstale":"2024-09-12T21:51:06.268117+0000","last_undegraded":"2024-09-12T21:51:06.268117+0000","last_fullsized":"2024-09-12T21:51:06.268117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268394+0000","last_change":"2024-09-12T21:50:39.853108+0000","last_active":"2024-09-12T21:51:06.268394+0000","last_peered":"2024-09-12T21:51:06.268394+0000","last_clean":"2024-09-12T21:51:06.268394+0000","last_became_active":"2024-09-12T21:50:39.851870+0000","last_became_peered":"2024-09-12T21:50:39.851870+0000","last_unstale":"2024-09-12T21:51:06.268394+0000","last_undegraded":"2024-09-12T21:51:06.268394+0000","last_fullsized":"2024-09-12T21:51:06.268394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:09.527443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267980+0000","last_change":"2024-09-12T21:50:39.852641+0000","last_active":"2024-09-12T21:51:06.267980+0000","last_peered":"2024-09-12T21:51:06.267980+0000","last_clean":"2024-09-12T21:51:06.267980+0000","last_became_active":"2024-09-12T21:50:39.852008+0000","last_became_peered":"2024-09-12T21:50:39.852008+0000","last_unstale":"2024-09-12T21:51:06.267980+0000","last_undegraded":"2024-09-12T21:51:06.267980+0000","last_fullsized":"2024-09-12T21:51:06.267980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:11.086738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268336+0000","last_change":"2024-09-12T21:50:39.846722+0000","last_active":"2024-09-12T21:51:06.268336+0000","last_peered":"2024-09-12T21:51:06.268336+0000","last_clean":"2024-09-12T21:51:06.268336+0000","last_became_active":"2024-09-12T21:50:39.846456+0000","last_became_peered":"2024-09-12T21:50:39.846456+0000","last_unstale":"2024-09-12T21:51:06.268336+0000","last_undegraded":"2024-09-12T21:51:06.268336+0000","last_fullsized":"2024-09-12T21:51:06.268336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267527+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:51:06.267527+0000","last_peered":"2024-09-12T21:51:06.267527+0000","last_clean":"2024-09-12T21:51:06.267527+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:51:06.267527+0000","last_undegraded":"2024-09-12T21:51:06.267527+0000","last_fullsized":"2024-09-12T21:51:06.267527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268200+0000","last_change":"2024-09-12T21:50:39.859092+0000","last_active":"2024-09-12T21:51:06.268200+0000","last_peered":"2024-09-12T21:51:06.268200+0000","last_clean":"2024-09-12T21:51:06.268200+0000","last_became_active":"2024-09-12T21:50:39.858907+0000","last_became_peered":"2024-09-12T21:50:39.858907+0000","last_unstale":"2024-09-12T21:51:06.268200+0000","last_undegraded":"2024-09-12T21:51:06.268200+0000","last_fullsized":"2024-09-12T21:51:06.268200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269054+0000","last_change":"2024-09-12T21:50:39.855157+0000","last_active":"2024-09-12T21:51:06.269054+0000","last_peered":"2024-09-12T21:51:06.269054+0000","last_clean":"2024-09-12T21:51:06.269054+0000","last_became_active":"2024-09-12T21:50:39.854469+0000","last_became_peered":"2024-09-12T21:50:39.854469+0000","last_unstale":"2024-09-12T21:51:06.269054+0000","last_undegraded":"2024-09-12T21:51:06.269054+0000","last_fullsized":"2024-09-12T21:51:06.269054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267583+0000","last_change":"2024-09-12T21:50:39.856627+0000","last_active":"2024-09-12T21:51:06.267583+0000","last_peered":"2024-09-12T21:51:06.267583+0000","last_clean":"2024-09-12T21:51:06.267583+0000","last_became_active":"2024-09-12T21:50:39.856302+0000","last_became_peered":"2024-09-12T21:50:39.856302+0000","last_unstale":"2024-09-12T21:51:06.267583+0000","last_undegraded":"2024-09-12T21:51:06.267583+0000","last_fullsized":"2024-09-12T21:51:06.267583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268699+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:51:06.268699+0000","last_peered":"2024-09-12T21:51:06.268699+0000","last_clean":"2024-09-12T21:51:06.268699+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:51:06.268699+0000","last_undegraded":"2024-09-12T21:51:06.268699+0000","last_fullsized":"2024-09-12T21:51:06.268699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267830+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:51:06.267830+0000","last_peered":"2024-09-12T21:51:06.267830+0000","last_clean":"2024-09-12T21:51:06.267830+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:51:06.267830+0000","last_undegraded":"2024-09-12T21:51:06.267830+0000","last_fullsized":"2024-09-12T21:51:06.267830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267936+0000","last_change":"2024-09-12T21:50:39.851210+0000","last_active":"2024-09-12T21:51:06.267936+0000","last_peered":"2024-09-12T21:51:06.267936+0000","last_clean":"2024-09-12T21:51:06.267936+0000","last_became_active":"2024-09-12T21:50:39.850831+0000","last_became_peered":"2024-09-12T21:50:39.850831+0000","last_unstale":"2024-09-12T21:51:06.267936+0000","last_undegraded":"2024-09-12T21:51:06.267936+0000","last_fullsized":"2024-09-12T21:51:06.267936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:37.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267120+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:51:06.267120+0000","last_peered":"2024-09-12T21:51:06.267120+0000","last_clean":"2024-09-12T21:51:06.267120+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:51:06.267120+0000","last_undegraded":"2024-09-12T21:51:06.267120+0000","last_fullsized":"2024-09-12T21:51:06.267120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269085+0000","last_change":"2024-09-12T21:50:39.854288+0000","last_active":"2024-09-12T21:51:06.269085+0000","last_peered":"2024-09-12T21:51:06.269085+0000","last_clean":"2024-09-12T21:51:06.269085+0000","last_became_active":"2024-09-12T21:50:39.852534+0000","last_became_peered":"2024-09-12T21:50:39.852534+0000","last_unstale":"2024-09-12T21:51:06.269085+0000","last_undegraded":"2024-09-12T21:51:06.269085+0000","last_fullsized":"2024-09-12T21:51:06.269085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:57.296356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269031+0000","last_change":"2024-09-12T21:50:39.856039+0000","last_active":"2024-09-12T21:51:06.269031+0000","last_peered":"2024-09-12T21:51:06.269031+0000","last_clean":"2024-09-12T21:51:06.269031+0000","last_became_active":"2024-09-12T21:50:39.855648+0000","last_became_peered":"2024-09-12T21:50:39.855648+0000","last_unstale":"2024-09-12T21:51:06.269031+0000","last_undegraded":"2024-09-12T21:51:06.269031+0000","last_fullsized":"2024-09-12T21:51:06.269031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267805+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:51:06.267805+0000","last_peered":"2024-09-12T21:51:06.267805+0000","last_clean":"2024-09-12T21:51:06.267805+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:51:06.267805+0000","last_undegraded":"2024-09-12T21:51:06.267805+0000","last_fullsized":"2024-09-12T21:51:06.267805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268685+0000","last_change":"2024-09-12T21:50:39.854978+0000","last_active":"2024-09-12T21:51:06.268685+0000","last_peered":"2024-09-12T21:51:06.268685+0000","last_clean":"2024-09-12T21:51:06.268685+0000","last_became_active":"2024-09-12T21:50:39.853933+0000","last_became_peered":"2024-09-12T21:50:39.853933+0000","last_unstale":"2024-09-12T21:51:06.268685+0000","last_undegraded":"2024-09-12T21:51:06.268685+0000","last_fullsized":"2024-09-12T21:51:06.268685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:56.340607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268253+0000","last_change":"2024-09-12T21:50:39.856848+0000","last_active":"2024-09-12T21:51:06.268253+0000","last_peered":"2024-09-12T21:51:06.268253+0000","last_clean":"2024-09-12T21:51:06.268253+0000","last_became_active":"2024-09-12T21:50:39.856502+0000","last_became_peered":"2024-09-12T21:50:39.856502+0000","last_unstale":"2024-09-12T21:51:06.268253+0000","last_undegraded":"2024-09-12T21:51:06.268253+0000","last_fullsized":"2024-09-12T21:51:06.268253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267760+0000","last_change":"2024-09-12T21:50:39.855976+0000","last_active":"2024-09-12T21:51:06.267760+0000","last_peered":"2024-09-12T21:51:06.267760+0000","last_clean":"2024-09-12T21:51:06.267760+0000","last_became_active":"2024-09-12T21:50:39.855349+0000","last_became_peered":"2024-09-12T21:50:39.855349+0000","last_unstale":"2024-09-12T21:51:06.267760+0000","last_undegraded":"2024-09-12T21:51:06.267760+0000","last_fullsized":"2024-09-12T21:51:06.267760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268025+0000","last_change":"2024-09-12T21:50:39.856261+0000","last_active":"2024-09-12T21:51:06.268025+0000","last_peered":"2024-09-12T21:51:06.268025+0000","last_clean":"2024-09-12T21:51:06.268025+0000","last_became_active":"2024-09-12T21:50:39.855891+0000","last_became_peered":"2024-09-12T21:50:39.855891+0000","last_unstale":"2024-09-12T21:51:06.268025+0000","last_undegraded":"2024-09-12T21:51:06.268025+0000","last_fullsized":"2024-09-12T21:51:06.268025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.581530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267138+0000","last_change":"2024-09-12T21:50:39.850466+0000","last_active":"2024-09-12T21:51:06.267138+0000","last_peered":"2024-09-12T21:51:06.267138+0000","last_clean":"2024-09-12T21:51:06.267138+0000","last_became_active":"2024-09-12T21:50:39.849431+0000","last_became_peered":"2024-09-12T21:50:39.849431+0000","last_unstale":"2024-09-12T21:51:06.267138+0000","last_undegraded":"2024-09-12T21:51:06.267138+0000","last_fullsized":"2024-09-12T21:51:06.267138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.156028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267581+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:51:06.267581+0000","last_peered":"2024-09-12T21:51:06.267581+0000","last_clean":"2024-09-12T21:51:06.267581+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:51:06.267581+0000","last_undegraded":"2024-09-12T21:51:06.267581+0000","last_fullsized":"2024-09-12T21:51:06.267581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268232+0000","last_change":"2024-09-12T21:50:39.853903+0000","last_active":"2024-09-12T21:51:06.268232+0000","last_peered":"2024-09-12T21:51:06.268232+0000","last_clean":"2024-09-12T21:51:06.268232+0000","last_became_active":"2024-09-12T21:50:39.853133+0000","last_became_peered":"2024-09-12T21:50:39.853133+0000","last_unstale":"2024-09-12T21:51:06.268232+0000","last_undegraded":"2024-09-12T21:51:06.268232+0000","last_fullsized":"2024-09-12T21:51:06.268232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268000+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:51:06.268000+0000","last_peered":"2024-09-12T21:51:06.268000+0000","last_clean":"2024-09-12T21:51:06.268000+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:51:06.268000+0000","last_undegraded":"2024-09-12T21:51:06.268000+0000","last_fullsized":"2024-09-12T21:51:06.268000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268454+0000","last_change":"2024-09-12T21:50:39.853955+0000","last_active":"2024-09-12T21:51:06.268454+0000","last_peered":"2024-09-12T21:51:06.268454+0000","last_clean":"2024-09-12T21:51:06.268454+0000","last_became_active":"2024-09-12T21:50:39.852567+0000","last_became_peered":"2024-09-12T21:50:39.852567+0000","last_unstale":"2024-09-12T21:51:06.268454+0000","last_undegraded":"2024-09-12T21:51:06.268454+0000","last_fullsized":"2024-09-12T21:51:06.268454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268563+0000","last_change":"2024-09-12T21:50:38.850437+0000","last_active":"2024-09-12T21:51:06.268563+0000","last_peered":"2024-09-12T21:51:06.268563+0000","last_clean":"2024-09-12T21:51:06.268563+0000","last_became_active":"2024-09-12T21:50:38.849732+0000","last_became_peered":"2024-09-12T21:50:38.849732+0000","last_unstale":"2024-09-12T21:51:06.268563+0000","last_undegraded":"2024-09-12T21:51:06.268563+0000","last_fullsized":"2024-09-12T21:51:06.268563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:27.129746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269151+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:51:06.269151+0000","last_peered":"2024-09-12T21:51:06.269151+0000","last_clean":"2024-09-12T21:51:06.269151+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:51:06.269151+0000","last_undegraded":"2024-09-12T21:51:06.269151+0000","last_fullsized":"2024-09-12T21:51:06.269151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267919+0000","last_change":"2024-09-12T21:50:38.851098+0000","last_active":"2024-09-12T21:51:06.267919+0000","last_peered":"2024-09-12T21:51:06.267919+0000","last_clean":"2024-09-12T21:51:06.267919+0000","last_became_active":"2024-09-12T21:50:38.850450+0000","last_became_peered":"2024-09-12T21:50:38.850450+0000","last_unstale":"2024-09-12T21:51:06.267919+0000","last_undegraded":"2024-09-12T21:51:06.267919+0000","last_fullsized":"2024-09-12T21:51:06.267919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:30.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267652+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:51:06.267652+0000","last_peered":"2024-09-12T21:51:06.267652+0000","last_clean":"2024-09-12T21:51:06.267652+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:51:06.267652+0000","last_undegraded":"2024-09-12T21:51:06.267652+0000","last_fullsized":"2024-09-12T21:51:06.267652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267700+0000","last_change":"2024-09-12T21:50:38.853933+0000","last_active":"2024-09-12T21:51:06.267700+0000","last_peered":"2024-09-12T21:51:06.267700+0000","last_clean":"2024-09-12T21:51:06.267700+0000","last_became_active":"2024-09-12T21:50:38.853524+0000","last_became_peered":"2024-09-12T21:50:38.853524+0000","last_unstale":"2024-09-12T21:51:06.267700+0000","last_undegraded":"2024-09-12T21:51:06.267700+0000","last_fullsized":"2024-09-12T21:51:06.267700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:37.429921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'2178","reported_seq":2196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.854647+0000","last_change":"2024-09-12T21:50:58.245933+0000","last_active":"2024-09-12T21:51:08.854647+0000","last_peered":"2024-09-12T21:51:08.854647+0000","last_clean":"2024-09-12T21:51:08.854647+0000","last_became_active":"2024-09-12T21:50:58.245678+0000","last_became_peered":"2024-09-12T21:50:58.245678+0000","last_unstale":"2024-09-12T21:51:08.854647+0000","last_undegraded":"2024-09-12T21:51:08.854647+0000","last_fullsized":"2024-09-12T21:51:08.854647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2178,"log_dups_size":0,"ondisk_log_size":2178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:53.667422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142737408,"num_objects":2178,"num_object_clones":0,"num_object_copies":4356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2178,"num_write_kb":139392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269241+0000","last_change":"2024-09-12T21:50:38.853499+0000","last_active":"2024-09-12T21:51:06.269241+0000","last_peered":"2024-09-12T21:51:06.269241+0000","last_clean":"2024-09-12T21:51:06.269241+0000","last_became_active":"2024-09-12T21:50:38.852678+0000","last_became_peered":"2024-09-12T21:50:38.852678+0000","last_unstale":"2024-09-12T21:51:06.269241+0000","last_undegraded":"2024-09-12T21:51:06.269241+0000","last_fullsized":"2024-09-12T21:51:06.269241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269238+0000","last_change":"2024-09-12T21:50:39.856181+0000","last_active":"2024-09-12T21:51:06.269238+0000","last_peered":"2024-09-12T21:51:06.269238+0000","last_clean":"2024-09-12T21:51:06.269238+0000","last_became_active":"2024-09-12T21:50:39.855858+0000","last_became_peered":"2024-09-12T21:50:39.855858+0000","last_unstale":"2024-09-12T21:51:06.269238+0000","last_undegraded":"2024-09-12T21:51:06.269238+0000","last_fullsized":"2024-09-12T21:51:06.269238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:18.134157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"26'2260","reported_seq":2278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863517+0000","last_change":"2024-09-12T21:50:58.246155+0000","last_active":"2024-09-12T21:51:08.863517+0000","last_peered":"2024-09-12T21:51:08.863517+0000","last_clean":"2024-09-12T21:51:08.863517+0000","last_became_active":"2024-09-12T21:50:58.245921+0000","last_became_peered":"2024-09-12T21:50:58.245921+0000","last_unstale":"2024-09-12T21:51:08.863517+0000","last_undegraded":"2024-09-12T21:51:08.863517+0000","last_fullsized":"2024-09-12T21:51:08.863517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:45.277951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148111360,"num_objects":2260,"num_object_clones":0,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2260,"num_write_kb":144640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269087+0000","last_change":"2024-09-12T21:50:38.850748+0000","last_active":"2024-09-12T21:51:06.269087+0000","last_peered":"2024-09-12T21:51:06.269087+0000","last_clean":"2024-09-12T21:51:06.269087+0000","last_became_active":"2024-09-12T21:50:38.850197+0000","last_became_peered":"2024-09-12T21:50:38.850197+0000","last_unstale":"2024-09-12T21:51:06.269087+0000","last_undegraded":"2024-09-12T21:51:06.269087+0000","last_fullsized":"2024-09-12T21:51:06.269087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:47.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267791+0000","last_change":"2024-09-12T21:50:39.852283+0000","last_active":"2024-09-12T21:51:06.267791+0000","last_peered":"2024-09-12T21:51:06.267791+0000","last_clean":"2024-09-12T21:51:06.267791+0000","last_became_active":"2024-09-12T21:50:39.851961+0000","last_became_peered":"2024-09-12T21:50:39.851961+0000","last_unstale":"2024-09-12T21:51:06.267791+0000","last_undegraded":"2024-09-12T21:51:06.267791+0000","last_fullsized":"2024-09-12T21:51:06.267791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:53.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"26'2121","reported_seq":2139,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.856898+0000","last_change":"2024-09-12T21:50:58.247516+0000","last_active":"2024-09-12T21:51:08.856898+0000","last_peered":"2024-09-12T21:51:08.856898+0000","last_clean":"2024-09-12T21:51:08.856898+0000","last_became_active":"2024-09-12T21:50:58.247295+0000","last_became_peered":"2024-09-12T21:50:58.247295+0000","last_unstale":"2024-09-12T21:51:08.856898+0000","last_undegraded":"2024-09-12T21:51:08.856898+0000","last_fullsized":"2024-09-12T21:51:08.856898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:24.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139001856,"num_objects":2121,"num_object_clones":0,"num_object_copies":4242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2121,"num_write_kb":135744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268850+0000","last_change":"2024-09-12T21:50:38.853622+0000","last_active":"2024-09-12T21:51:06.268850+0000","last_peered":"2024-09-12T21:51:06.268850+0000","last_clean":"2024-09-12T21:51:06.268850+0000","last_became_active":"2024-09-12T21:50:38.853278+0000","last_became_peered":"2024-09-12T21:50:38.853278+0000","last_unstale":"2024-09-12T21:51:06.268850+0000","last_undegraded":"2024-09-12T21:51:06.268850+0000","last_fullsized":"2024-09-12T21:51:06.268850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268096+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:51:06.268096+0000","last_peered":"2024-09-12T21:51:06.268096+0000","last_clean":"2024-09-12T21:51:06.268096+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:51:06.268096+0000","last_undegraded":"2024-09-12T21:51:06.268096+0000","last_fullsized":"2024-09-12T21:51:06.268096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"26'2162","reported_seq":2180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863370+0000","last_change":"2024-09-12T21:50:58.246517+0000","last_active":"2024-09-12T21:51:08.863370+0000","last_peered":"2024-09-12T21:51:08.863370+0000","last_clean":"2024-09-12T21:51:08.863370+0000","last_became_active":"2024-09-12T21:50:58.246253+0000","last_became_peered":"2024-09-12T21:50:58.246253+0000","last_unstale":"2024-09-12T21:51:08.863370+0000","last_undegraded":"2024-09-12T21:51:08.863370+0000","last_fullsized":"2024-09-12T21:51:08.863370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:45.277951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141688832,"num_objects":2162,"num_object_clones":0,"num_object_copies":4324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2162,"num_write_kb":138368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269033+0000","last_change":"2024-09-12T21:50:38.850504+0000","last_active":"2024-09-12T21:51:06.269033+0000","last_peered":"2024-09-12T21:51:06.269033+0000","last_clean":"2024-09-12T21:51:06.269033+0000","last_became_active":"2024-09-12T21:50:38.850133+0000","last_became_peered":"2024-09-12T21:50:38.850133+0000","last_unstale":"2024-09-12T21:51:06.269033+0000","last_undegraded":"2024-09-12T21:51:06.269033+0000","last_fullsized":"2024-09-12T21:51:06.269033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267987+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:51:06.267987+0000","last_peered":"2024-09-12T21:51:06.267987+0000","last_clean":"2024-09-12T21:51:06.267987+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:51:06.267987+0000","last_undegraded":"2024-09-12T21:51:06.267987+0000","last_fullsized":"2024-09-12T21:51:06.267987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"26'2207","reported_seq":2225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863322+0000","last_change":"2024-09-12T21:50:58.251593+0000","last_active":"2024-09-12T21:51:08.863322+0000","last_peered":"2024-09-12T21:51:08.863322+0000","last_clean":"2024-09-12T21:51:08.863322+0000","last_became_active":"2024-09-12T21:50:58.251353+0000","last_became_peered":"2024-09-12T21:50:58.251353+0000","last_unstale":"2024-09-12T21:51:08.863322+0000","last_undegraded":"2024-09-12T21:51:08.863322+0000","last_fullsized":"2024-09-12T21:51:08.863322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2207,"log_dups_size":0,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.153155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":4414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268164+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:51:06.268164+0000","last_peered":"2024-09-12T21:51:06.268164+0000","last_clean":"2024-09-12T21:51:06.268164+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:51:06.268164+0000","last_undegraded":"2024-09-12T21:51:06.268164+0000","last_fullsized":"2024-09-12T21:51:06.268164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268775+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:51:06.268775+0000","last_peered":"2024-09-12T21:51:06.268775+0000","last_clean":"2024-09-12T21:51:06.268775+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:51:06.268775+0000","last_undegraded":"2024-09-12T21:51:06.268775+0000","last_fullsized":"2024-09-12T21:51:06.268775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"26'2090","reported_seq":2108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870144+0000","last_change":"2024-09-12T21:50:58.251553+0000","last_active":"2024-09-12T21:51:08.870144+0000","last_peered":"2024-09-12T21:51:08.870144+0000","last_clean":"2024-09-12T21:51:08.870144+0000","last_became_active":"2024-09-12T21:50:58.251247+0000","last_became_peered":"2024-09-12T21:50:58.251247+0000","last_unstale":"2024-09-12T21:51:08.870144+0000","last_undegraded":"2024-09-12T21:51:08.870144+0000","last_fullsized":"2024-09-12T21:51:08.870144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2090,"log_dups_size":0,"ondisk_log_size":2090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:24.527868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136970240,"num_objects":2090,"num_object_clones":0,"num_object_copies":4180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2090,"num_write_kb":133760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268154+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:51:06.268154+0000","last_peered":"2024-09-12T21:51:06.268154+0000","last_clean":"2024-09-12T21:51:06.268154+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:51:06.268154+0000","last_undegraded":"2024-09-12T21:51:06.268154+0000","last_fullsized":"2024-09-12T21:51:06.268154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268769+0000","last_change":"2024-09-12T21:50:39.852937+0000","last_active":"2024-09-12T21:51:06.268769+0000","last_peered":"2024-09-12T21:51:06.268769+0000","last_clean":"2024-09-12T21:51:06.268769+0000","last_became_active":"2024-09-12T21:50:39.851478+0000","last_became_peered":"2024-09-12T21:50:39.851478+0000","last_unstale":"2024-09-12T21:51:06.268769+0000","last_undegraded":"2024-09-12T21:51:06.268769+0000","last_fullsized":"2024-09-12T21:51:06.268769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.851513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"26'2200","reported_seq":2218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.869207+0000","last_change":"2024-09-12T21:50:58.245944+0000","last_active":"2024-09-12T21:51:08.869207+0000","last_peered":"2024-09-12T21:51:08.869207+0000","last_clean":"2024-09-12T21:51:08.869207+0000","last_became_active":"2024-09-12T21:50:58.245687+0000","last_became_peered":"2024-09-12T21:50:58.245687+0000","last_unstale":"2024-09-12T21:51:08.869207+0000","last_undegraded":"2024-09-12T21:51:08.869207+0000","last_fullsized":"2024-09-12T21:51:08.869207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2200,"log_dups_size":0,"ondisk_log_size":2200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.777355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144179200,"num_objects":2200,"num_object_clones":0,"num_object_copies":4400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2200,"num_write_kb":140800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267988+0000","last_change":"2024-09-12T21:50:38.850527+0000","last_active":"2024-09-12T21:51:06.267988+0000","last_peered":"2024-09-12T21:51:06.267988+0000","last_clean":"2024-09-12T21:51:06.267988+0000","last_became_active":"2024-09-12T21:50:38.849751+0000","last_became_peered":"2024-09-12T21:50:38.849751+0000","last_unstale":"2024-09-12T21:51:06.267988+0000","last_undegraded":"2024-09-12T21:51:06.267988+0000","last_fullsized":"2024-09-12T21:51:06.267988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.311922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268715+0000","last_change":"2024-09-12T21:50:39.851402+0000","last_active":"2024-09-12T21:51:06.268715+0000","last_peered":"2024-09-12T21:51:06.268715+0000","last_clean":"2024-09-12T21:51:06.268715+0000","last_became_active":"2024-09-12T21:50:39.850552+0000","last_became_peered":"2024-09-12T21:50:39.850552+0000","last_unstale":"2024-09-12T21:51:06.268715+0000","last_undegraded":"2024-09-12T21:51:06.268715+0000","last_fullsized":"2024-09-12T21:51:06.268715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:08.353129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"26'2252","reported_seq":2270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858255+0000","last_change":"2024-09-12T21:50:58.247657+0000","last_active":"2024-09-12T21:51:08.858255+0000","last_peered":"2024-09-12T21:51:08.858255+0000","last_clean":"2024-09-12T21:51:08.858255+0000","last_became_active":"2024-09-12T21:50:58.247417+0000","last_became_peered":"2024-09-12T21:50:58.247417+0000","last_unstale":"2024-09-12T21:51:08.858255+0000","last_undegraded":"2024-09-12T21:51:08.858255+0000","last_fullsized":"2024-09-12T21:51:08.858255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:54.350208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147587072,"num_objects":2252,"num_object_clones":0,"num_object_copies":4504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2252,"num_write_kb":144128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269319+0000","last_change":"2024-09-12T21:50:38.851613+0000","last_active":"2024-09-12T21:51:06.269319+0000","last_peered":"2024-09-12T21:51:06.269319+0000","last_clean":"2024-09-12T21:51:06.269319+0000","last_became_active":"2024-09-12T21:50:38.851386+0000","last_became_peered":"2024-09-12T21:50:38.851386+0000","last_unstale":"2024-09-12T21:51:06.269319+0000","last_undegraded":"2024-09-12T21:51:06.269319+0000","last_fullsized":"2024-09-12T21:51:06.269319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:01.389466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267713+0000","last_change":"2024-09-12T21:50:39.857162+0000","last_active":"2024-09-12T21:51:06.267713+0000","last_peered":"2024-09-12T21:51:06.267713+0000","last_clean":"2024-09-12T21:51:06.267713+0000","last_became_active":"2024-09-12T21:50:39.856632+0000","last_became_peered":"2024-09-12T21:50:39.856632+0000","last_unstale":"2024-09-12T21:51:06.267713+0000","last_undegraded":"2024-09-12T21:51:06.267713+0000","last_fullsized":"2024-09-12T21:51:06.267713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"26'2201","reported_seq":2219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858903+0000","last_change":"2024-09-12T21:50:58.247583+0000","last_active":"2024-09-12T21:51:08.858903+0000","last_peered":"2024-09-12T21:51:08.858903+0000","last_clean":"2024-09-12T21:51:08.858903+0000","last_became_active":"2024-09-12T21:50:58.247340+0000","last_became_peered":"2024-09-12T21:50:58.247340+0000","last_unstale":"2024-09-12T21:51:08.858903+0000","last_undegraded":"2024-09-12T21:51:08.858903+0000","last_fullsized":"2024-09-12T21:51:08.858903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2201,"log_dups_size":0,"ondisk_log_size":2201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.602801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144244736,"num_objects":2201,"num_object_clones":0,"num_object_copies":4402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2201,"num_write_kb":140864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267883+0000","last_change":"2024-09-12T21:50:30.703709+0000","last_active":"2024-09-12T21:51:06.267883+0000","last_peered":"2024-09-12T21:51:06.267883+0000","last_clean":"2024-09-12T21:51:06.267883+0000","last_became_active":"2024-09-12T21:50:30.703376+0000","last_became_peered":"2024-09-12T21:50:30.703376+0000","last_unstale":"2024-09-12T21:51:06.267883+0000","last_undegraded":"2024-09-12T21:51:06.267883+0000","last_fullsized":"2024-09-12T21:51:06.267883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:42.579140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268098+0000","last_change":"2024-09-12T21:50:36.721811+0000","last_active":"2024-09-12T21:51:06.268098+0000","last_peered":"2024-09-12T21:51:06.268098+0000","last_clean":"2024-09-12T21:51:06.268098+0000","last_became_active":"2024-09-12T21:50:34.717884+0000","last_became_peered":"2024-09-12T21:50:34.717884+0000","last_unstale":"2024-09-12T21:51:06.268098+0000","last_undegraded":"2024-09-12T21:51:06.268098+0000","last_fullsized":"2024-09-12T21:51:06.268098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:57.267137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268646+0000","last_change":"2024-09-12T21:50:38.849601+0000","last_active":"2024-09-12T21:51:06.268646+0000","last_peered":"2024-09-12T21:51:06.268646+0000","last_clean":"2024-09-12T21:51:06.268646+0000","last_became_active":"2024-09-12T21:50:38.848936+0000","last_became_peered":"2024-09-12T21:50:38.848936+0000","last_unstale":"2024-09-12T21:51:06.268646+0000","last_undegraded":"2024-09-12T21:51:06.268646+0000","last_fullsized":"2024-09-12T21:51:06.268646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:13.128883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268826+0000","last_change":"2024-09-12T21:50:39.855824+0000","last_active":"2024-09-12T21:51:06.268826+0000","last_peered":"2024-09-12T21:51:06.268826+0000","last_clean":"2024-09-12T21:51:06.268826+0000","last_became_active":"2024-09-12T21:50:39.853997+0000","last_became_peered":"2024-09-12T21:50:39.853997+0000","last_unstale":"2024-09-12T21:51:06.268826+0000","last_undegraded":"2024-09-12T21:51:06.268826+0000","last_fullsized":"2024-09-12T21:51:06.268826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:15.306768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'2195","reported_seq":2209,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870186+0000","last_change":"2024-09-12T21:50:58.246826+0000","last_active":"2024-09-12T21:51:08.870186+0000","last_peered":"2024-09-12T21:51:08.870186+0000","last_clean":"2024-09-12T21:51:08.870186+0000","last_became_active":"2024-09-12T21:50:58.246661+0000","last_became_peered":"2024-09-12T21:50:58.246661+0000","last_unstale":"2024-09-12T21:51:08.870186+0000","last_undegraded":"2024-09-12T21:51:08.870186+0000","last_fullsized":"2024-09-12T21:51:08.870186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:45.282947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143851520,"num_objects":2195,"num_object_clones":0,"num_object_copies":4390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2195,"num_write_kb":140480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267802+0000","last_change":"2024-09-12T21:50:36.721534+0000","last_active":"2024-09-12T21:51:06.267802+0000","last_peered":"2024-09-12T21:51:06.267802+0000","last_clean":"2024-09-12T21:51:06.267802+0000","last_became_active":"2024-09-12T21:50:34.718643+0000","last_became_peered":"2024-09-12T21:50:34.718643+0000","last_unstale":"2024-09-12T21:51:06.267802+0000","last_undegraded":"2024-09-12T21:51:06.267802+0000","last_fullsized":"2024-09-12T21:51:06.267802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.978882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267432+0000","last_change":"2024-09-12T21:50:38.848648+0000","last_active":"2024-09-12T21:51:06.267432+0000","last_peered":"2024-09-12T21:51:06.267432+0000","last_clean":"2024-09-12T21:51:06.267432+0000","last_became_active":"2024-09-12T21:50:38.847755+0000","last_became_peered":"2024-09-12T21:50:38.847755+0000","last_unstale":"2024-09-12T21:51:06.267432+0000","last_undegraded":"2024-09-12T21:51:06.267432+0000","last_fullsized":"2024-09-12T21:51:06.267432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268973+0000","last_change":"2024-09-12T21:50:39.855088+0000","last_active":"2024-09-12T21:51:06.268973+0000","last_peered":"2024-09-12T21:51:06.268973+0000","last_clean":"2024-09-12T21:51:06.268973+0000","last_became_active":"2024-09-12T21:50:39.854384+0000","last_became_peered":"2024-09-12T21:50:39.854384+0000","last_unstale":"2024-09-12T21:51:06.268973+0000","last_undegraded":"2024-09-12T21:51:06.268973+0000","last_fullsized":"2024-09-12T21:51:06.268973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"26'2207","reported_seq":2225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.869780+0000","last_change":"2024-09-12T21:50:58.251551+0000","last_active":"2024-09-12T21:51:08.869780+0000","last_peered":"2024-09-12T21:51:08.869780+0000","last_clean":"2024-09-12T21:51:08.869780+0000","last_became_active":"2024-09-12T21:50:58.251281+0000","last_became_peered":"2024-09-12T21:50:58.251281+0000","last_unstale":"2024-09-12T21:51:08.869780+0000","last_undegraded":"2024-09-12T21:51:08.869780+0000","last_fullsized":"2024-09-12T21:51:08.869780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2207,"log_dups_size":0,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.153155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":4414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267540+0000","last_change":"2024-09-12T21:50:36.721236+0000","last_active":"2024-09-12T21:51:06.267540+0000","last_peered":"2024-09-12T21:51:06.267540+0000","last_clean":"2024-09-12T21:51:06.267540+0000","last_became_active":"2024-09-12T21:50:34.718623+0000","last_became_peered":"2024-09-12T21:50:34.718623+0000","last_unstale":"2024-09-12T21:51:06.267540+0000","last_undegraded":"2024-09-12T21:51:06.267540+0000","last_fullsized":"2024-09-12T21:51:06.267540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:22.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269405+0000","last_change":"2024-09-12T21:50:38.851075+0000","last_active":"2024-09-12T21:51:06.269405+0000","last_peered":"2024-09-12T21:51:06.269405+0000","last_clean":"2024-09-12T21:51:06.269405+0000","last_became_active":"2024-09-12T21:50:38.849978+0000","last_became_peered":"2024-09-12T21:50:38.849978+0000","last_unstale":"2024-09-12T21:51:06.269405+0000","last_undegraded":"2024-09-12T21:51:06.269405+0000","last_fullsized":"2024-09-12T21:51:06.269405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:56.473572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267733+0000","last_change":"2024-09-12T21:50:39.858839+0000","last_active":"2024-09-12T21:51:06.267733+0000","last_peered":"2024-09-12T21:51:06.267733+0000","last_clean":"2024-09-12T21:51:06.267733+0000","last_became_active":"2024-09-12T21:50:39.858610+0000","last_became_peered":"2024-09-12T21:50:39.858610+0000","last_unstale":"2024-09-12T21:51:06.267733+0000","last_undegraded":"2024-09-12T21:51:06.267733+0000","last_fullsized":"2024-09-12T21:51:06.267733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'2196","reported_seq":2214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.864128+0000","last_change":"2024-09-12T21:50:58.251500+0000","last_active":"2024-09-12T21:51:08.864128+0000","last_peered":"2024-09-12T21:51:08.864128+0000","last_clean":"2024-09-12T21:51:08.864128+0000","last_became_active":"2024-09-12T21:50:58.251206+0000","last_became_peered":"2024-09-12T21:50:58.251206+0000","last_unstale":"2024-09-12T21:51:08.864128+0000","last_undegraded":"2024-09-12T21:51:08.864128+0000","last_fullsized":"2024-09-12T21:51:08.864128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2196,"log_dups_size":0,"ondisk_log_size":2196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.602801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143917056,"num_objects":2196,"num_object_clones":0,"num_object_copies":4392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2196,"num_write_kb":140544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268232+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:51:06.268232+0000","last_peered":"2024-09-12T21:51:06.268232+0000","last_clean":"2024-09-12T21:51:06.268232+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:51:06.268232+0000","last_undegraded":"2024-09-12T21:51:06.268232+0000","last_fullsized":"2024-09-12T21:51:06.268232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268052+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:51:06.268052+0000","last_peered":"2024-09-12T21:51:06.268052+0000","last_clean":"2024-09-12T21:51:06.268052+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:51:06.268052+0000","last_undegraded":"2024-09-12T21:51:06.268052+0000","last_fullsized":"2024-09-12T21:51:06.268052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268511+0000","last_change":"2024-09-12T21:50:39.855980+0000","last_active":"2024-09-12T21:51:06.268511+0000","last_peered":"2024-09-12T21:51:06.268511+0000","last_clean":"2024-09-12T21:51:06.268511+0000","last_became_active":"2024-09-12T21:50:39.855579+0000","last_became_peered":"2024-09-12T21:50:39.855579+0000","last_unstale":"2024-09-12T21:51:06.268511+0000","last_undegraded":"2024-09-12T21:51:06.268511+0000","last_fullsized":"2024-09-12T21:51:06.268511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'2287","reported_seq":2305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.863408+0000","last_change":"2024-09-12T21:50:58.251572+0000","last_active":"2024-09-12T21:51:08.863408+0000","last_peered":"2024-09-12T21:51:08.863408+0000","last_clean":"2024-09-12T21:51:08.863408+0000","last_became_active":"2024-09-12T21:50:58.251291+0000","last_became_peered":"2024-09-12T21:50:58.251291+0000","last_unstale":"2024-09-12T21:51:08.863408+0000","last_undegraded":"2024-09-12T21:51:08.863408+0000","last_fullsized":"2024-09-12T21:51:08.863408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:44.155310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149880832,"num_objects":2287,"num_object_clones":0,"num_object_copies":4574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2287,"num_write_kb":146368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268919+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:51:06.268919+0000","last_peered":"2024-09-12T21:51:06.268919+0000","last_clean":"2024-09-12T21:51:06.268919+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:51:06.268919+0000","last_undegraded":"2024-09-12T21:51:06.268919+0000","last_fullsized":"2024-09-12T21:51:06.268919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268667+0000","last_change":"2024-09-12T21:50:36.721260+0000","last_active":"2024-09-12T21:51:06.268667+0000","last_peered":"2024-09-12T21:51:06.268667+0000","last_clean":"2024-09-12T21:51:06.268667+0000","last_became_active":"2024-09-12T21:50:34.718674+0000","last_became_peered":"2024-09-12T21:50:34.718674+0000","last_unstale":"2024-09-12T21:51:06.268667+0000","last_undegraded":"2024-09-12T21:51:06.268667+0000","last_fullsized":"2024-09-12T21:51:06.268667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:27.058008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267941+0000","last_change":"2024-09-12T21:50:39.850859+0000","last_active":"2024-09-12T21:51:06.267941+0000","last_peered":"2024-09-12T21:51:06.267941+0000","last_clean":"2024-09-12T21:51:06.267941+0000","last_became_active":"2024-09-12T21:50:39.850482+0000","last_became_peered":"2024-09-12T21:50:39.850482+0000","last_unstale":"2024-09-12T21:51:06.267941+0000","last_undegraded":"2024-09-12T21:51:06.267941+0000","last_fullsized":"2024-09-12T21:51:06.267941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:39.780976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"26'2223","reported_seq":2241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.851100+0000","last_change":"2024-09-12T21:50:58.247553+0000","last_active":"2024-09-12T21:51:08.851100+0000","last_peered":"2024-09-12T21:51:08.851100+0000","last_clean":"2024-09-12T21:51:08.851100+0000","last_became_active":"2024-09-12T21:50:58.247363+0000","last_became_peered":"2024-09-12T21:50:58.247363+0000","last_unstale":"2024-09-12T21:51:08.851100+0000","last_undegraded":"2024-09-12T21:51:08.851100+0000","last_fullsized":"2024-09-12T21:51:08.851100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2223,"log_dups_size":0,"ondisk_log_size":2223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:59.192092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145686528,"num_objects":2223,"num_object_clones":0,"num_object_copies":4446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2223,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268593+0000","last_change":"2024-09-12T21:50:38.850597+0000","last_active":"2024-09-12T21:51:06.268593+0000","last_peered":"2024-09-12T21:51:06.268593+0000","last_clean":"2024-09-12T21:51:06.268593+0000","last_became_active":"2024-09-12T21:50:38.849789+0000","last_became_peered":"2024-09-12T21:50:38.849789+0000","last_unstale":"2024-09-12T21:51:06.268593+0000","last_undegraded":"2024-09-12T21:51:06.268593+0000","last_fullsized":"2024-09-12T21:51:06.268593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268797+0000","last_change":"2024-09-12T21:50:36.721958+0000","last_active":"2024-09-12T21:51:06.268797+0000","last_peered":"2024-09-12T21:51:06.268797+0000","last_clean":"2024-09-12T21:51:06.268797+0000","last_became_active":"2024-09-12T21:50:34.718082+0000","last_became_peered":"2024-09-12T21:50:34.718082+0000","last_unstale":"2024-09-12T21:51:06.268797+0000","last_undegraded":"2024-09-12T21:51:06.268797+0000","last_fullsized":"2024-09-12T21:51:06.268797+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:22.634098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048354399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268413+0000","last_change":"2024-09-12T21:50:39.851077+0000","last_active":"2024-09-12T21:51:06.268413+0000","last_peered":"2024-09-12T21:51:06.268413+0000","last_clean":"2024-09-12T21:51:06.268413+0000","last_became_active":"2024-09-12T21:50:39.850621+0000","last_became_peered":"2024-09-12T21:50:39.850621+0000","last_unstale":"2024-09-12T21:51:06.268413+0000","last_undegraded":"2024-09-12T21:51:06.268413+0000","last_fullsized":"2024-09-12T21:51:06.268413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.853584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"26'2146","reported_seq":2164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.870109+0000","last_change":"2024-09-12T21:50:58.246163+0000","last_active":"2024-09-12T21:51:08.870109+0000","last_peered":"2024-09-12T21:51:08.870109+0000","last_clean":"2024-09-12T21:51:08.870109+0000","last_became_active":"2024-09-12T21:50:58.245866+0000","last_became_peered":"2024-09-12T21:50:58.245866+0000","last_unstale":"2024-09-12T21:51:08.870109+0000","last_undegraded":"2024-09-12T21:51:08.870109+0000","last_fullsized":"2024-09-12T21:51:08.870109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:39.661924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140640256,"num_objects":2146,"num_object_clones":0,"num_object_copies":4292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2146,"num_write_kb":137344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268284+0000","last_change":"2024-09-12T21:50:38.850829+0000","last_active":"2024-09-12T21:51:06.268284+0000","last_peered":"2024-09-12T21:51:06.268284+0000","last_clean":"2024-09-12T21:51:06.268284+0000","last_became_active":"2024-09-12T21:50:38.849486+0000","last_became_peered":"2024-09-12T21:50:38.849486+0000","last_unstale":"2024-09-12T21:51:06.268284+0000","last_undegraded":"2024-09-12T21:51:06.268284+0000","last_fullsized":"2024-09-12T21:51:06.268284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.886961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269288+0000","last_change":"2024-09-12T21:50:36.721477+0000","last_active":"2024-09-12T21:51:06.269288+0000","last_peered":"2024-09-12T21:51:06.269288+0000","last_clean":"2024-09-12T21:51:06.269288+0000","last_became_active":"2024-09-12T21:50:34.718626+0000","last_became_peered":"2024-09-12T21:50:34.718626+0000","last_unstale":"2024-09-12T21:51:06.269288+0000","last_undegraded":"2024-09-12T21:51:06.269288+0000","last_fullsized":"2024-09-12T21:51:06.269288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:24.911815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267489+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:51:06.267489+0000","last_peered":"2024-09-12T21:51:06.267489+0000","last_clean":"2024-09-12T21:51:06.267489+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:51:06.267489+0000","last_undegraded":"2024-09-12T21:51:06.267489+0000","last_fullsized":"2024-09-12T21:51:06.267489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"26'2195","reported_seq":2212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:08.858170+0000","last_change":"2024-09-12T21:50:58.247690+0000","last_active":"2024-09-12T21:51:08.858170+0000","last_peered":"2024-09-12T21:51:08.858170+0000","last_clean":"2024-09-12T21:51:08.858170+0000","last_became_active":"2024-09-12T21:50:58.247399+0000","last_became_peered":"2024-09-12T21:50:58.247399+0000","last_unstale":"2024-09-12T21:51:08.858170+0000","last_undegraded":"2024-09-12T21:51:08.858170+0000","last_fullsized":"2024-09-12T21:51:08.858170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:57.235150+0000","last_clean_scrub_stamp":"2024-09-12T21:50:57.235150+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:44.155310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143851520,"num_objects":2195,"num_object_clones":0,"num_object_copies":4390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2195,"num_write_kb":140480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269198+0000","last_change":"2024-09-12T21:50:38.850422+0000","last_active":"2024-09-12T21:51:06.269198+0000","last_peered":"2024-09-12T21:51:06.269198+0000","last_clean":"2024-09-12T21:51:06.269198+0000","last_became_active":"2024-09-12T21:50:38.849532+0000","last_became_peered":"2024-09-12T21:50:38.849532+0000","last_unstale":"2024-09-12T21:51:06.269198+0000","last_undegraded":"2024-09-12T21:51:06.269198+0000","last_fullsized":"2024-09-12T21:51:06.269198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269294+0000","last_change":"2024-09-12T21:50:36.721576+0000","last_active":"2024-09-12T21:51:06.269294+0000","last_peered":"2024-09-12T21:51:06.269294+0000","last_clean":"2024-09-12T21:51:06.269294+0000","last_became_active":"2024-09-12T21:50:34.718709+0000","last_became_peered":"2024-09-12T21:50:34.718709+0000","last_unstale":"2024-09-12T21:51:06.269294+0000","last_undegraded":"2024-09-12T21:51:06.269294+0000","last_fullsized":"2024-09-12T21:51:06.269294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.688297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267792+0000","last_change":"2024-09-12T21:50:39.851239+0000","last_active":"2024-09-12T21:51:06.267792+0000","last_peered":"2024-09-12T21:51:06.267792+0000","last_clean":"2024-09-12T21:51:06.267792+0000","last_became_active":"2024-09-12T21:50:39.850571+0000","last_became_peered":"2024-09-12T21:50:39.850571+0000","last_unstale":"2024-09-12T21:51:06.267792+0000","last_undegraded":"2024-09-12T21:51:06.267792+0000","last_fullsized":"2024-09-12T21:51:06.267792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.261256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267948+0000","last_change":"2024-09-12T21:50:39.853138+0000","last_active":"2024-09-12T21:51:06.267948+0000","last_peered":"2024-09-12T21:51:06.267948+0000","last_clean":"2024-09-12T21:51:06.267948+0000","last_became_active":"2024-09-12T21:50:39.852093+0000","last_became_peered":"2024-09-12T21:50:39.852093+0000","last_unstale":"2024-09-12T21:51:06.267948+0000","last_undegraded":"2024-09-12T21:51:06.267948+0000","last_fullsized":"2024-09-12T21:51:06.267948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268945+0000","last_change":"2024-09-12T21:50:38.853500+0000","last_active":"2024-09-12T21:51:06.268945+0000","last_peered":"2024-09-12T21:51:06.268945+0000","last_clean":"2024-09-12T21:51:06.268945+0000","last_became_active":"2024-09-12T21:50:38.852216+0000","last_became_peered":"2024-09-12T21:50:38.852216+0000","last_unstale":"2024-09-12T21:51:06.268945+0000","last_undegraded":"2024-09-12T21:51:06.268945+0000","last_fullsized":"2024-09-12T21:51:06.268945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268464+0000","last_change":"2024-09-12T21:50:39.855595+0000","last_active":"2024-09-12T21:51:06.268464+0000","last_peered":"2024-09-12T21:51:06.268464+0000","last_clean":"2024-09-12T21:51:06.268464+0000","last_became_active":"2024-09-12T21:50:39.855218+0000","last_became_peered":"2024-09-12T21:50:39.855218+0000","last_unstale":"2024-09-12T21:51:06.268464+0000","last_undegraded":"2024-09-12T21:51:06.268464+0000","last_fullsized":"2024-09-12T21:51:06.268464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268733+0000","last_change":"2024-09-12T21:50:38.851237+0000","last_active":"2024-09-12T21:51:06.268733+0000","last_peered":"2024-09-12T21:51:06.268733+0000","last_clean":"2024-09-12T21:51:06.268733+0000","last_became_active":"2024-09-12T21:50:38.850796+0000","last_became_peered":"2024-09-12T21:50:38.850796+0000","last_unstale":"2024-09-12T21:51:06.268733+0000","last_undegraded":"2024-09-12T21:51:06.268733+0000","last_fullsized":"2024-09-12T21:51:06.268733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:12.467488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268633+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:51:06.268633+0000","last_peered":"2024-09-12T21:51:06.268633+0000","last_clean":"2024-09-12T21:51:06.268633+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:51:06.268633+0000","last_undegraded":"2024-09-12T21:51:06.268633+0000","last_fullsized":"2024-09-12T21:51:06.268633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267209+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:51:06.267209+0000","last_peered":"2024-09-12T21:51:06.267209+0000","last_clean":"2024-09-12T21:51:06.267209+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:51:06.267209+0000","last_undegraded":"2024-09-12T21:51:06.267209+0000","last_fullsized":"2024-09-12T21:51:06.267209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268194+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:51:06.268194+0000","last_peered":"2024-09-12T21:51:06.268194+0000","last_clean":"2024-09-12T21:51:06.268194+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:51:06.268194+0000","last_undegraded":"2024-09-12T21:51:06.268194+0000","last_fullsized":"2024-09-12T21:51:06.268194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267440+0000","last_change":"2024-09-12T21:50:39.850207+0000","last_active":"2024-09-12T21:51:06.267440+0000","last_peered":"2024-09-12T21:51:06.267440+0000","last_clean":"2024-09-12T21:51:06.267440+0000","last_became_active":"2024-09-12T21:50:39.849546+0000","last_became_peered":"2024-09-12T21:50:39.849546+0000","last_unstale":"2024-09-12T21:51:06.267440+0000","last_undegraded":"2024-09-12T21:51:06.267440+0000","last_fullsized":"2024-09-12T21:51:06.267440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:44.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269075+0000","last_change":"2024-09-12T21:50:39.856115+0000","last_active":"2024-09-12T21:51:06.269075+0000","last_peered":"2024-09-12T21:51:06.269075+0000","last_clean":"2024-09-12T21:51:06.269075+0000","last_became_active":"2024-09-12T21:50:39.855743+0000","last_became_peered":"2024-09-12T21:50:39.855743+0000","last_unstale":"2024-09-12T21:51:06.269075+0000","last_undegraded":"2024-09-12T21:51:06.269075+0000","last_fullsized":"2024-09-12T21:51:06.269075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267536+0000","last_change":"2024-09-12T21:50:38.849456+0000","last_active":"2024-09-12T21:51:06.267536+0000","last_peered":"2024-09-12T21:51:06.267536+0000","last_clean":"2024-09-12T21:51:06.267536+0000","last_became_active":"2024-09-12T21:50:38.848631+0000","last_became_peered":"2024-09-12T21:50:38.848631+0000","last_unstale":"2024-09-12T21:51:06.267536+0000","last_undegraded":"2024-09-12T21:51:06.267536+0000","last_fullsized":"2024-09-12T21:51:06.267536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:16.832575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268723+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:51:06.268723+0000","last_peered":"2024-09-12T21:51:06.268723+0000","last_clean":"2024-09-12T21:51:06.268723+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:51:06.268723+0000","last_undegraded":"2024-09-12T21:51:06.268723+0000","last_fullsized":"2024-09-12T21:51:06.268723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267343+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:51:06.267343+0000","last_peered":"2024-09-12T21:51:06.267343+0000","last_clean":"2024-09-12T21:51:06.267343+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:51:06.267343+0000","last_undegraded":"2024-09-12T21:51:06.267343+0000","last_fullsized":"2024-09-12T21:51:06.267343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268349+0000","last_change":"2024-09-12T21:50:39.857706+0000","last_active":"2024-09-12T21:51:06.268349+0000","last_peered":"2024-09-12T21:51:06.268349+0000","last_clean":"2024-09-12T21:51:06.268349+0000","last_became_active":"2024-09-12T21:50:39.857062+0000","last_became_peered":"2024-09-12T21:50:39.857062+0000","last_unstale":"2024-09-12T21:51:06.268349+0000","last_undegraded":"2024-09-12T21:51:06.268349+0000","last_fullsized":"2024-09-12T21:51:06.268349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268205+0000","last_change":"2024-09-12T21:50:38.850736+0000","last_active":"2024-09-12T21:51:06.268205+0000","last_peered":"2024-09-12T21:51:06.268205+0000","last_clean":"2024-09-12T21:51:06.268205+0000","last_became_active":"2024-09-12T21:50:38.849917+0000","last_became_peered":"2024-09-12T21:50:38.849917+0000","last_unstale":"2024-09-12T21:51:06.268205+0000","last_undegraded":"2024-09-12T21:51:06.268205+0000","last_fullsized":"2024-09-12T21:51:06.268205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268166+0000","last_change":"2024-09-12T21:50:39.853008+0000","last_active":"2024-09-12T21:51:06.268166+0000","last_peered":"2024-09-12T21:51:06.268166+0000","last_clean":"2024-09-12T21:51:06.268166+0000","last_became_active":"2024-09-12T21:50:39.852384+0000","last_became_peered":"2024-09-12T21:50:39.852384+0000","last_unstale":"2024-09-12T21:51:06.268166+0000","last_undegraded":"2024-09-12T21:51:06.268166+0000","last_fullsized":"2024-09-12T21:51:06.268166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:08.653518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268493+0000","last_change":"2024-09-12T21:50:38.850319+0000","last_active":"2024-09-12T21:51:06.268493+0000","last_peered":"2024-09-12T21:51:06.268493+0000","last_clean":"2024-09-12T21:51:06.268493+0000","last_became_active":"2024-09-12T21:50:38.849969+0000","last_became_peered":"2024-09-12T21:50:38.849969+0000","last_unstale":"2024-09-12T21:51:06.268493+0000","last_undegraded":"2024-09-12T21:51:06.268493+0000","last_fullsized":"2024-09-12T21:51:06.268493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:59.200746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267860+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:51:06.267860+0000","last_peered":"2024-09-12T21:51:06.267860+0000","last_clean":"2024-09-12T21:51:06.267860+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:51:06.267860+0000","last_undegraded":"2024-09-12T21:51:06.267860+0000","last_fullsized":"2024-09-12T21:51:06.267860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268855+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:51:06.268855+0000","last_peered":"2024-09-12T21:51:06.268855+0000","last_clean":"2024-09-12T21:51:06.268855+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:51:06.268855+0000","last_undegraded":"2024-09-12T21:51:06.268855+0000","last_fullsized":"2024-09-12T21:51:06.268855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268096+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:51:06.268096+0000","last_peered":"2024-09-12T21:51:06.268096+0000","last_clean":"2024-09-12T21:51:06.268096+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:51:06.268096+0000","last_undegraded":"2024-09-12T21:51:06.268096+0000","last_fullsized":"2024-09-12T21:51:06.268096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268567+0000","last_change":"2024-09-12T21:50:38.850709+0000","last_active":"2024-09-12T21:51:06.268567+0000","last_peered":"2024-09-12T21:51:06.268567+0000","last_clean":"2024-09-12T21:51:06.268567+0000","last_became_active":"2024-09-12T21:50:38.850163+0000","last_became_peered":"2024-09-12T21:50:38.850163+0000","last_unstale":"2024-09-12T21:51:06.268567+0000","last_undegraded":"2024-09-12T21:51:06.268567+0000","last_fullsized":"2024-09-12T21:51:06.268567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:57.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268072+0000","last_change":"2024-09-12T21:50:39.855073+0000","last_active":"2024-09-12T21:51:06.268072+0000","last_peered":"2024-09-12T21:51:06.268072+0000","last_clean":"2024-09-12T21:51:06.268072+0000","last_became_active":"2024-09-12T21:50:39.853538+0000","last_became_peered":"2024-09-12T21:50:39.853538+0000","last_unstale":"2024-09-12T21:51:06.268072+0000","last_undegraded":"2024-09-12T21:51:06.268072+0000","last_fullsized":"2024-09-12T21:51:06.268072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.269071+0000","last_change":"2024-09-12T21:50:38.849770+0000","last_active":"2024-09-12T21:51:06.269071+0000","last_peered":"2024-09-12T21:51:06.269071+0000","last_clean":"2024-09-12T21:51:06.269071+0000","last_became_active":"2024-09-12T21:50:38.849033+0000","last_became_peered":"2024-09-12T21:50:38.849033+0000","last_unstale":"2024-09-12T21:51:06.269071+0000","last_undegraded":"2024-09-12T21:51:06.269071+0000","last_fullsized":"2024-09-12T21:51:06.269071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.267720+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:51:06.267720+0000","last_peered":"2024-09-12T21:51:06.267720+0000","last_clean":"2024-09-12T21:51:06.267720+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:51:06.267720+0000","last_undegraded":"2024-09-12T21:51:06.267720+0000","last_fullsized":"2024-09-12T21:51:06.267720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T21:51:06.268029+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:51:06.268029+0000","last_peered":"2024-09-12T21:51:06.268029+0000","last_clean":"2024-09-12T21:51:06.268029+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:51:06.268029+0000","last_undegraded":"2024-09-12T21:51:06.268029+0000","last_fullsized":"2024-09-12T21:51:06.268029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2301624320,"num_objects":35120,"num_object_clones":0,"num_object_copies":70240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35120,"num_write_kb":2247680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4604428288,"data_stored":4604428288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35120,"ondisk_log_size":35120,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1325532,"kb_used_data":1263820,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":93046308,"statfs":{"total":96636764160,"available":95279419392,"internally_reserved":0,"allocated":1294151680,"data_stored":1293971385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1870028,"kb_used_data":1812476,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92501812,"statfs":{"total":96636764160,"available":94721855488,"internally_reserved":0,"allocated":1855975424,"data_stored":1855809810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1387368,"kb_used_data":1329816,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92984472,"statfs":{"total":96636764160,"available":95216099328,"internally_reserved":0,"allocated":1361731584,"data_stored":1361539636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1437532160,"data_stored":1437532160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1870594048,"data_stored":1870594048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1296302080,"data_stored":1296302080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:51:11.985 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T21:51:11.985 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T21:51:11.985 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T21:51:11.986 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T21:51:11.986 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T21:51:11.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T21:51:11.986 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:11.987 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:12.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:12.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:12.080 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:12.079+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T21:51:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:12.141 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:12.141 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:12.154 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:12.180 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:12.180 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:12.180 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:12.179+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:12.199 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:12.217 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:12.217 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:12.281 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:12.280+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:51:12.337 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:12.338 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:51:12.338 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-09-12T21:51:12.338 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-09-12T21:51:12.338 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:12.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:12.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 13 16 44658 44642 214.606 158.688 0.0066072 0.00465218 2024-09-12T21:51:12.381 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:12.380+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:12.483 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:12.482+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:21139 5.b 5:dc3ad759:::benchmark_data_smithi053_32461_object21138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1421411179999996, 2024-09-12T21:51:12.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012331592000000001, 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21139 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379150+0000", 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379151+0000", 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.09e-07 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379221+0000", 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0544999999999996e-05 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379229+0000", 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0320000000000003e-06 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379234+0000", 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.775e-06 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379267+0000", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3003999999999998e-05 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379347+0000", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9589e-05 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.379422+0000", 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5605000000000005e-05 2024-09-12T21:51:12.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.380307+0000", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088479300000000004 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391392+0000", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011084513000000001 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391445+0000", 2024-09-12T21:51:12.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3204000000000001e-05 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.391482+0000", 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6723000000000001e-05 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.530 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:23090 5.4 5:2e81616b:::benchmark_data_smithi053_32461_object23089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:12.531 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5555319450000002, 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01213414, 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 23090 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965759+0000", 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965760+0000", 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3799999999999996e-07 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965819+0000", 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9373999999999998e-05 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965829+0000", 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4939999999999992e-06 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965835+0000", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9529999999999996e-06 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.965884+0000", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9539000000000001e-05 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966010+0000", 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012580600000000001 2024-09-12T21:51:12.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.966140+0000", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013002000000000001 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.968987+0000", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00284688 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977819+0000", 2024-09-12T21:51:12.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088322220000000007 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977854+0000", 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4391000000000003e-05 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:04.977893+0000", 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9523000000000001e-05 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:32767 5.0 5:0f59ad8c:::benchmark_data_smithi053_32461_object32766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4770603610000004, 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012670320000000001, 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 32767 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.538 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044231+0000", 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999999e-07 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044363+0000", 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013128 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044368+0000", 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2020000000000003e-06 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.044371+0000", 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6009999999999999e-06 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045181+0000", 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080990000000000001 2024-09-12T21:51:12.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045306+0000", 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012480999999999999 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.045425+0000", 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118447 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.048953+0000", 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035280839999999999 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056844+0000", 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078913790000000004 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056878+0000", 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4289999999999999e-05 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.056901+0000", 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2731e-05 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33574 5.0 5:03ed3d84:::benchmark_data_smithi053_32461_object33573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2082893779999999, 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012351961, 2024-09-12T21:51:12.544 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33574 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313002+0000", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.92e-07 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313060+0000", 2024-09-12T21:51:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7497000000000002e-05 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313067+0000", 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2819999999999999e-06 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313071+0000", 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1540000000000004e-06 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313131+0000", 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9923000000000002e-05 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313253+0000", 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121456 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.313375+0000", 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012266800000000001 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.317117+0000", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003741861 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325302+0000", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081848040000000004 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325330+0000", 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8357999999999999e-05 2024-09-12T21:51:12.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.325354+0000", 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3166000000000001e-05 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33707 5.e 5:73eae7d5:::benchmark_data_smithi053_32461_object33706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1597440020000001, 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013616368, 2024-09-12T21:51:12.550 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33707 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361547+0000", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361548+0000", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1299999999999999e-07 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361631+0000", 2024-09-12T21:51:12.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2731999999999993e-05 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361642+0000", 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1766000000000001e-05 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361649+0000", 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8159999999999996e-06 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361688+0000", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8483999999999999e-05 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361762+0000", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4380000000000003e-05 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.361845+0000", 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3212000000000002e-05 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.365488+0000", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036427030000000002 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375109+0000", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096212829999999996 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375140+0000", 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1197e-05 2024-09-12T21:51:12.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.375163+0000", 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3082e-05 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33823 5.4 5:250ef8ff:::benchmark_data_smithi053_32461_object33822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1211582949999999, 2024-09-12T21:51:12.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012740616, 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33823 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400133+0000", 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.99e-07 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400233+0000", 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9438000000000006e-05 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400242+0000", 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400248+0000", 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0190000000000003e-06 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400290+0000", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2052000000000003e-05 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400434+0000", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014423600000000001 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400541+0000", 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106549 2024-09-12T21:51:12.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401879+0000", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001338285 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412781+0000", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010901611 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412831+0000", 2024-09-12T21:51:12.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9688999999999998e-05 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412873+0000", 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2858000000000002e-05 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:33824 5.4 5:20c4d936:::benchmark_data_smithi053_32461_object33823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:12.562 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1208704940000001, 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012609146999999999, 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 33824 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:12.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400421+0000", 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1399999999999996e-07 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400448+0000", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6795999999999999e-05 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400458+0000", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5310000000000007e-06 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.400464+0000", 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0809999999999999e-06 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401158+0000", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000694037 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401238+0000", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0457999999999994e-05 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.401315+0000", 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6380999999999999e-05 2024-09-12T21:51:12.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.402455+0000", 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00114057 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412912+0000", 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010456933 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.412967+0000", 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4765999999999997e-05 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.413030+0000", 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2780000000000005e-05 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:34951 5.0 5:02df5328:::benchmark_data_smithi053_32461_object34950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.568 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.712491714, 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013370132999999999, 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34951 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808799+0000", 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808800+0000", 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808875+0000", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5116000000000004e-05 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808883+0000", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1839999999999999e-06 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808896+0000", 2024-09-12T21:51:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2318e-05 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.808942+0000", 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6164e-05 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.809073+0000", 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000131617 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.809188+0000", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115041 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.810747+0000", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015582250000000001 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822108+0000", 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011361338 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822143+0000", 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5410000000000001e-05 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.822169+0000", 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6086999999999999e-05 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:35115 5.0 5:01e8d215:::benchmark_data_smithi053_32461_object35114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.655183643, 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013392878, 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35115 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866107+0000", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866108+0000", 2024-09-12T21:51:12.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8699999999999995e-07 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866185+0000", 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6627999999999999e-05 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866191+0000", 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2859999999999996e-06 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866194+0000", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.253e-06 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866225+0000", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0867000000000001e-05 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866304+0000", 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.866383+0000", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9221999999999995e-05 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.868291+0000", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019078369999999999 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879430+0000", 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011139438 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879465+0000", 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5160000000000002e-05 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:08.879500+0000", 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4984999999999998e-05 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:36611 5.f e27/21 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head v 27'2289, mlcod=27'2285)", 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1460550340000002, 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013594696, 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375236+0000", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8799999999999998e-07 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375318+0000", 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2051000000000004e-05 2024-09-12T21:51:12.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375326+0000", 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4259999999999997e-06 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375331+0000", 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0459999999999996e-06 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375368+0000", 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7379999999999998e-05 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.375385+0000", 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6322999999999999e-05 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.388773+0000", 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013388666 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.388831+0000", 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7416000000000001e-05 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37204 5.e 5:78668cb0:::benchmark_data_smithi053_32461_object37203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.576999+0000", 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.944292184, 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013818819, 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.585 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37204 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.576999+0000", 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.576999+0000", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.576999+0000", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5700000000000002e-07 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.577026+0000", 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6108000000000001e-05 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.577031+0000", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0309999999999998e-06 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.577054+0000", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3557000000000002e-05 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.583815+0000", 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067606180000000004 2024-09-12T21:51:12.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.583908+0000", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3327999999999998e-05 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.584019+0000", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011089 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.587036+0000", 2024-09-12T21:51:12.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030173869999999998 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.590732+0000", 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003695196 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.590781+0000", 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9768000000000002e-05 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.590818+0000", 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6378999999999998e-05 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37340 5.b 5:dfaf75ff:::benchmark_data_smithi053_32461_object37339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.623306+0000", 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.8979850300000001, 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012213002000000001, 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.591 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37340 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623306+0000", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623306+0000", 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623307+0000", 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0999999999999998e-07 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623393+0000", 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5867999999999998e-05 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623403+0000", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0135999999999999e-05 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623409+0000", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.964e-06 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623611+0000", 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020210399999999999 2024-09-12T21:51:12.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623722+0000", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111155 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623878+0000", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000156014 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.626881+0000", 2024-09-12T21:51:12.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030029319999999998 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635430+0000", 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085492250000000006 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635481+0000", 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0968999999999999e-05 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635519+0000", 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7925e-05 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37341 5.b 5:d162ac1f:::benchmark_data_smithi053_32461_object37340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.623844+0000", 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.8974471619999997, 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012108852999999999, 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.597 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37341 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623844+0000", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623844+0000", 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623845+0000", 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2699999999999999e-07 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.623992+0000", 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014738500000000001 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.624001+0000", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9779999999999994e-06 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.624008+0000", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5470000000000002e-06 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.624856+0000", 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084847600000000003 2024-09-12T21:51:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.624991+0000", 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013544699999999999 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.625127+0000", 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013579999999999999 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.626884+0000", 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017566439999999999 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635893+0000", 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090092109999999996 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635928+0000", 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4804000000000001e-05 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.635953+0000", 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4834e-05 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37608 5.b 5:d1446abb:::benchmark_data_smithi053_32461_object37607:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.726338+0000", 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.7949528720000001, 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013066423000000001, 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.603 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37608 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726338+0000", 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726338+0000", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726339+0000", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7300000000000005e-07 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726503+0000", 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016410700000000001 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726512+0000", 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8589999999999994e-06 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726517+0000", 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3070000000000002e-06 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726568+0000", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1100000000000002e-05 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726696+0000", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012795600000000001 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.726888+0000", 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019176299999999999 2024-09-12T21:51:12.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.729915+0000", 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030272509999999999 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.739304+0000", 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093882219999999999 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.739367+0000", 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3448000000000006e-05 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.739405+0000", 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7537000000000003e-05 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37690 5.b 5:d79f655a:::benchmark_data_smithi053_32461_object37689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.609 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.753991+0000", 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.7673000720000003, 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013951174, 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37690 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.753991+0000", 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.753991+0000", 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.753992+0000", 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6199999999999997e-07 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754049+0000", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6895999999999999e-05 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754057+0000", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7399999999999993e-06 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754061+0000", 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1389999999999997e-06 2024-09-12T21:51:12.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754095+0000", 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3207000000000002e-05 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754181+0000", 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6112999999999994e-05 2024-09-12T21:51:12.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.754259+0000", 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7943999999999998e-05 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.757415+0000", 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003156762 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.767872+0000", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010456101000000001 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.767904+0000", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2466999999999999e-05 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.767942+0000", 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8142999999999997e-05 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37695 5.b 5:d75eb682:::benchmark_data_smithi053_32461_object37694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.756400+0000", 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.7648912490000002, 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012526963, 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37695 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756400+0000", 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756400+0000", 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756400+0000", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0900000000000001e-07 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756458+0000", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7221e-05 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756466+0000", 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:12.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756470+0000", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9190000000000001e-06 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756507+0000", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7011000000000002e-05 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756588+0000", 2024-09-12T21:51:12.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0947999999999998e-05 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.756668+0000", 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0197999999999993e-05 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.757746+0000", 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001078166 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.768836+0000", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011089786000000001 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.768891+0000", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5504000000000003e-05 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.768927+0000", 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5549000000000001e-05 2024-09-12T21:51:12.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:37861 5.b 5:ddcf7d3d:::benchmark_data_smithi053_32461_object37860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:09.815255+0000", 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.7060364809999999, 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013037847999999999, 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 37861 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815255+0000", 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815255+0000", 2024-09-12T21:51:12.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815256+0000", 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.33e-07 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815357+0000", 2024-09-12T21:51:12.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101955 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815365+0000", 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3409999999999997e-06 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.815369+0000", 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3470000000000001e-06 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.820876+0000", 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055064500000000004 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.820950+0000", 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4229999999999999e-05 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.821038+0000", 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8635999999999996e-05 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.823040+0000", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002002013 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.828239+0000", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051984930000000002 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.828270+0000", 2024-09-12T21:51:12.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0858000000000002e-05 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:09.828292+0000", 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2592e-05 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:44571 5.0 5:0c03b65a:::benchmark_data_smithi053_32461_object44570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:12.311785+0000", 2024-09-12T21:51:12.628 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.209505846, 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012414402, 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 44571 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311785+0000", 2024-09-12T21:51:12.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311785+0000", 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311786+0000", 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1600000000000002e-07 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311820+0000", 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3902999999999997e-05 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311826+0000", 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7710000000000001e-06 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.311832+0000", 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4500000000000003e-06 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.313639+0000", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001807737 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.313752+0000", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112315 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.313883+0000", 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013159900000000001 2024-09-12T21:51:12.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.315915+0000", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020313369999999998 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.324110+0000", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081951320000000008 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.324160+0000", 2024-09-12T21:51:12.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9985000000000003e-05 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.324200+0000", 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9756999999999999e-05 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:44647 5.d 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:12.339739+0000", 2024-09-12T21:51:12.634 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.18155170400000001, 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.066603599999999999, 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 44647 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339739+0000", 2024-09-12T21:51:12.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339739+0000", 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339740+0000", 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.47e-07 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339884+0000", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014397600000000001 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339895+0000", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0426e-05 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339901+0000", 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.353e-06 2024-09-12T21:51:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.339961+0000", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0526000000000003e-05 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.340088+0000", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126341 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.340245+0000", 2024-09-12T21:51:12.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015672 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.344264+0000", 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040192489999999999 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.061976093000000003 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.406295+0000", 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4818000000000003e-05 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.406343+0000", 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8251000000000003e-05 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.640 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:44883 5.0 5:0f0d1e4c:::benchmark_data_smithi053_32461_object44882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:12.487647+0000", 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.033644260000000002, 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012896942999999999, 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 44883 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:12.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487647+0000", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487647+0000", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487647+0000", 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4199999999999996e-07 2024-09-12T21:51:12.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487676+0000", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8370000000000001e-05 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487684+0000", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4999999999999999e-06 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.487690+0000", 2024-09-12T21:51:12.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6529999999999999e-06 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.488350+0000", 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00066030199999999998 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.488472+0000", 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121555 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:12.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.488601+0000", 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129567 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.492285+0000", 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003683511 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.500478+0000", 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081929220000000001 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.500520+0000", 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2511e-05 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:12.500544+0000", 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.351e-05 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:12.646 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:12.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:12.648 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:12.646+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:12.749 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:12.748+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:12.792 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.792 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:45710 5.9 5:9b5e3767:::benchmark_data_smithi053_32461_object45709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.783314+0000", 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0085131670000000003, 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0085312400000000007, 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 45710 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:12.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783314+0000", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783314+0000", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783315+0000", 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:12.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783351+0000", 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5809999999999998e-05 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783359+0000", 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3000000000000002e-06 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783365+0000", 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.241e-06 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783472+0000", 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010663899999999999 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783615+0000", 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014332599999999999 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.783760+0000", 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144998 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.787378+0000", 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036175180000000001 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:45717 5.9 5:9ec435e7:::benchmark_data_smithi053_32461_object45716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.785199+0000", 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0066285520000000002, 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066960869999999999, 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 45717 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:12.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785199+0000", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785199+0000", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785200+0000", 2024-09-12T21:51:12.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785292+0000", 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.255e-05 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785300+0000", 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2989999999999997e-06 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:12.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785307+0000", 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.866e-06 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785397+0000", 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9269000000000002e-05 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785507+0000", 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011006 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.785582+0000", 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5436000000000001e-05 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.787791+0000", 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022089739999999998 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:12.802 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 2 2024-09-12T21:51:12.803 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:12.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:12.849 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:12.849+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:12.939 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:12.939 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:12.939 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:12.939 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:12.939 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:12.951 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:12.950+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:12.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:13.051 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:13.051+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:13.133 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 33.282853330999998, 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014234999, 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848505+0000", 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848506+0000", 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7599999999999998e-07 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848508+0000", 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.334e-06 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848513+0000", 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6990000000000002e-06 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.848516+0000", 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6349999999999999e-06 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856735+0000", 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082186740000000005 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856800+0000", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5495999999999998e-05 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.856936+0000", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013602300000000001 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.859761+0000", 2024-09-12T21:51:13.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028247319999999999 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862641+0000", 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028799590000000001 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862699+0000", 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7525999999999998e-05 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:50:39.862740+0000", 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1545000000000003e-05 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18259 5.2 5:4460e580:::benchmark_data_smithi053_32461_object18258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5864174300000009, 2024-09-12T21:51:13.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015716200999999999, 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18259 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544942+0000", 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544996+0000", 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3995000000000001e-05 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545001+0000", 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545005+0000", 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.546e-06 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545379+0000", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00037468100000000003 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545480+0000", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101196 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545561+0000", 2024-09-12T21:51:13.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0630000000000006e-05 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.547246+0000", 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001685211 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560600+0000", 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013353535 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560633+0000", 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2703000000000002e-05 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560657+0000", 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4814999999999999e-05 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24220 5.7 5:ed2a18dc:::benchmark_data_smithi053_32461_object24219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.8147763750000001, 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013367179999999999, 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.147 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24220 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316582+0000", 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316583+0000", 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4099999999999999e-07 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316681+0000", 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8423000000000003e-05 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316693+0000", 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2244e-05 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316698+0000", 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9309999999999999e-06 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321457+0000", 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047584009999999998 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321554+0000", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6971000000000004e-05 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.321638+0000", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4296999999999996e-05 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.326640+0000", 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050019540000000003 2024-09-12T21:51:13.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329884+0000", 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032438839999999998 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329919+0000", 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5162e-05 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329949+0000", 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0471999999999999e-05 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:24225 5.7 5:e1897741:::benchmark_data_smithi053_32461_object24224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.8145678610000004, 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013263021999999999, 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.153 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 24225 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316791+0000", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1800000000000002e-07 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316947+0000", 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000155797 2024-09-12T21:51:13.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316952+0000", 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.592e-06 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.316956+0000", 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5080000000000001e-06 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322448+0000", 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005491831 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322523+0000", 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5512000000000005e-05 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.322599+0000", 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5836999999999999e-05 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.326693+0000", 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040941179999999999 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.329982+0000", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032890929999999999 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330029+0000", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7157999999999998e-05 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:05.330054+0000", 2024-09-12T21:51:13.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4258000000000001e-05 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:33660 5.1 5:8493626d:::benchmark_data_smithi053_32461_object33659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.7906481479999998, 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015436170000000001, 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.160 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33660 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:13.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340711+0000", 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4499999999999996e-07 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340757+0000", 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5770999999999999e-05 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340775+0000", 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7881e-05 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340782+0000", 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.342899+0000", 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021175199999999999 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.343016+0000", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117235 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.343141+0000", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012494900000000001 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.348967+0000", 2024-09-12T21:51:13.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058254759999999996 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356090+0000", 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0071233310000000001 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356122+0000", 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1551999999999999e-05 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356147+0000", 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4987e-05 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:33662 5.1 5:85ef63ad:::benchmark_data_smithi053_32461_object33661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.341596+0000", 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.7897623490000001, 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014596609999999999, 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.166 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33662 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341596+0000", 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341596+0000", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341597+0000", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7300000000000005e-07 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341645+0000", 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7444999999999997e-05 2024-09-12T21:51:13.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341654+0000", 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0599999999999997e-06 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.341660+0000", 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.489e-06 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.345892+0000", 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0042318629999999998 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.345999+0000", 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107308 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.346122+0000", 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012310500000000001 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.351992+0000", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058693800000000004 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356152+0000", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004159963 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356175+0000", 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2891000000000002e-05 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356193+0000", 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8233e-05 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:34088 5.2 5:4e395165:::benchmark_data_smithi053_32461_object34087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6282969610000002, 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907631, 2024-09-12T21:51:13.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34088 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503123+0000", 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1043999999999994e-05 2024-09-12T21:51:13.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503134+0000", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0159999999999999e-05 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503140+0000", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503822+0000", 2024-09-12T21:51:13.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00068234899999999995 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503929+0000", 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107324 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.504049+0000", 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120228 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.506076+0000", 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020266759999999998 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520873+0000", 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01479723 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520928+0000", 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4268999999999998e-05 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520969+0000", 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1650999999999998e-05 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:35107 5.7 5:e66031f7:::benchmark_data_smithi053_32461_object35106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.863550+0000", 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2678082579999996, 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014962893999999999, 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.178 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35107 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863550+0000", 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863550+0000", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863551+0000", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7899999999999998e-07 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863687+0000", 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000136026 2024-09-12T21:51:13.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863695+0000", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.863702+0000", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.024e-06 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.865792+0000", 2024-09-12T21:51:13.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002089891 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.865925+0000", 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000132738 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.866050+0000", 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012493000000000001 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.868729+0000", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026791699999999998 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.878449+0000", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0097206459999999995 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.878485+0000", 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5706e-05 2024-09-12T21:51:13.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.878513+0000", 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8016000000000001e-05 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:35111 5.7 5:e49b5fe4:::benchmark_data_smithi053_32461_object35110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.864150+0000", 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.2672087550000004, 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.014976645, 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.185 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 35111 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864150+0000", 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864150+0000", 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864150+0000", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6199999999999998e-07 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864201+0000", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0751999999999998e-05 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864212+0000", 2024-09-12T21:51:13.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.046e-05 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.864217+0000", 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5690000000000004e-06 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.866768+0000", 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025512239999999999 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.866901+0000", 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000133044 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.866987+0000", 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6157999999999997e-05 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.868733+0000", 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001745351 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.879078+0000", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010345078000000001 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.879106+0000", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8396999999999999e-05 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.879126+0000", 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0149999999999999e-05 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.190 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:36611 5.f 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7597590240000001, 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017415061999999999, 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.191 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 36611 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371654+0000", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4367999999999999e-05 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371662+0000", 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:51:13.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371667+0000", 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-06 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374826+0000", 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031582749999999999 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374938+0000", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111957 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.375059+0000", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121073 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.377750+0000", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026908750000000001 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388919+0000", 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011169231 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388974+0000", 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5612000000000002e-05 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.389015+0000", 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0145000000000003e-05 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.799003307, 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.197 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:13.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:13.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79873073900000002, 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.203 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:13.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79867281400000001, 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:13.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:13.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.214 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79760084499999995, 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:13.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:13.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79405226399999995, 2024-09-12T21:51:13.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:13.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79273510999999997, 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.226 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:13.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:13.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79238103500000001, 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:13.232 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79177320500000004, 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:13.236 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:13.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:13.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.791753763, 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:13.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.244 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.79104726999999997, 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:13.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:13.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:13.249 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:13.250 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:13.249+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:13.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:13.351 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:13.350+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:13.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 14 16 47265 47249 210.915 162.938 0.00569793 0.00473822 2024-09-12T21:51:13.402 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47360 5.3 5:c384002d:::benchmark_data_smithi053_32461_object47359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.389948+0000", 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011228660999999999, 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011253353000000001, 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47360 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.389948+0000", 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.389948+0000", 2024-09-12T21:51:13.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.389949+0000", 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.390032+0000", 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3271999999999998e-05 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.390040+0000", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1999999999999997e-06 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.390046+0000", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5660000000000003e-06 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394390+0000", 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043435970000000003 2024-09-12T21:51:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394476+0000", 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5901000000000003e-05 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394565+0000", 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9176000000000001e-05 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400281+0000", 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057162280000000003 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47368 5.3 5:c24b2bc7:::benchmark_data_smithi053_32461_object47367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.391733+0000", 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094444170000000001, 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095202180000000004, 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47368 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391733+0000", 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391733+0000", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391734+0000", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5300000000000002e-07 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391850+0000", 2024-09-12T21:51:13.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011637300000000001 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391867+0000", 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7399999999999999e-05 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.391874+0000", 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8290000000000002e-06 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396251+0000", 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043772990000000003 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396395+0000", 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143163 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396496+0000", 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101721 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400314+0000", 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038179350000000002 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47367 5.b e30/21 5:d0030017:::benchmark_data_smithi053_32461_object47366:head v 30'2864, mlcod=30'2862)", 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.392247+0000", 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089300609999999996, 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009047256, 2024-09-12T21:51:13.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392247+0000", 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392247+0000", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392248+0000", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392316+0000", 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8388999999999999e-05 2024-09-12T21:51:13.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392322+0000", 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5490000000000003e-06 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392327+0000", 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3800000000000004e-06 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394388+0000", 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020607849999999999 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394403+0000", 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5235999999999999e-05 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47364 5.e e30/21 5:7a0d19fa:::benchmark_data_smithi053_32461_object47363:head v 30'3082, mlcod=30'3079)", 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.392336+0000", 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0088409600000000001, 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089897569999999993, 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392336+0000", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392336+0000", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392336+0000", 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.53e-07 2024-09-12T21:51:13.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392360+0000", 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3243000000000001e-05 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392365+0000", 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.451e-06 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.392368+0000", 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0230000000000001e-06 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394343+0000", 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001975147 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394362+0000", 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8717999999999999e-05 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47370 5.e e30/21 5:7c2c4dd8:::benchmark_data_smithi053_32461_object47369:head v 30'3083, mlcod=30'3079)", 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.393484+0000", 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0076934480000000003, 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078722540000000004, 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393484+0000", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393484+0000", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393484+0000", 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:13.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393518+0000", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3951000000000001e-05 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393528+0000", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0006e-05 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.393533+0000", 2024-09-12T21:51:13.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395387+0000", 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018535890000000001 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395405+0000", 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8283000000000001e-05 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47372 5.2 e30/21 5:457dac1f:::benchmark_data_smithi053_32461_object47371:head v 30'2928, mlcod=30'2926)", 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.394700+0000", 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0064769490000000001, 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066857430000000001, 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394700+0000", 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394700+0000", 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394701+0000", 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0699999999999997e-07 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394755+0000", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4187999999999997e-05 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394765+0000", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0485e-05 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394771+0000", 2024-09-12T21:51:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0750000000000003e-06 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394819+0000", 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7839000000000001e-05 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.394837+0000", 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7453999999999999e-05 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47376 5.6 5:6660a626:::benchmark_data_smithi053_32461_object47375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.395516+0000", 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056609490000000002, 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059012650000000002, 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47376 2024-09-12T21:51:13.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395516+0000", 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395516+0000", 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395517+0000", 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0800000000000004e-07 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395586+0000", 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9307999999999994e-05 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395594+0000", 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1009999999999992e-06 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395599+0000", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0200000000000002e-06 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395634+0000", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4672000000000003e-05 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395747+0000", 2024-09-12T21:51:13.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113053 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395832+0000", 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5278000000000006e-05 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400184+0000", 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043520939999999999 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47373 5.7 e30/21 5:e22b71f5:::benchmark_data_smithi053_32461_object47372:head v 30'2966, mlcod=30'2964)", 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.395662+0000", 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055154210000000004, 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057967629999999999, 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395662+0000", 2024-09-12T21:51:13.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395662+0000", 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395662+0000", 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-07 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395721+0000", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8439000000000001e-05 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395731+0000", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0206e-05 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395737+0000", 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7649999999999999e-06 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395778+0000", 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1724000000000002e-05 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395795+0000", 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7042999999999999e-05 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47375 5.4 e30/21 5:21df9a5d:::benchmark_data_smithi053_32461_object47374:head v 30'2971, mlcod=30'2968)", 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.395905+0000", 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052723550000000003, 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055824869999999997, 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395905+0000", 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395905+0000", 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395905+0000", 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6199999999999998e-07 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395937+0000", 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1643000000000002e-05 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395946+0000", 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7860000000000002e-06 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.395951+0000", 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5759999999999996e-06 2024-09-12T21:51:13.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396009+0000", 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7741000000000002e-05 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396025+0000", 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6486000000000001e-05 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47374 5.2 e30/21 5:49ddcc86:::benchmark_data_smithi053_32461_object47373:head v 30'2929, mlcod=30'2926)", 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.396519+0000", 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046580019999999996, 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049968690000000001, 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396519+0000", 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396519+0000", 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396520+0000", 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2499999999999995e-07 2024-09-12T21:51:13.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396547+0000", 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7932999999999998e-05 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396556+0000", 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4749999999999993e-06 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396562+0000", 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1859999999999997e-06 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396605+0000", 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2675000000000001e-05 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.396629+0000", 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.446 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47377 5.6 5:67a6f4c4:::benchmark_data_smithi053_32461_object47376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.397351+0000", 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038264309999999999, 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041958630000000002, 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47377 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397351+0000", 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397351+0000", 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397352+0000", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.06e-06 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397429+0000", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6963000000000002e-05 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397437+0000", 2024-09-12T21:51:13.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6580000000000008e-06 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397442+0000", 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0139999999999998e-06 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397653+0000", 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021122099999999999 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397803+0000", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014965599999999999 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.397968+0000", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016503700000000001 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400247+0000", 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00227837 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47378 5.e e30/21 5:77e24e85:::benchmark_data_smithi053_32461_object47377:head v 30'3084, mlcod=30'3080)", 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.398120+0000", 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003056628, 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034641479999999998, 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398120+0000", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398120+0000", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398121+0000", 2024-09-12T21:51:13.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398186+0000", 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4893000000000004e-05 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398195+0000", 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7159999999999992e-06 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398201+0000", 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400136+0000", 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001934605 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400155+0000", 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9513000000000001e-05 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.455 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47379 5.0 e30/21 5:0388aacc:::benchmark_data_smithi053_32461_object47378:head v 30'2912, mlcod=30'2910)", 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.398227+0000", 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002950074, 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033863750000000001, 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398227+0000", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398227+0000", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398227+0000", 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9799999999999999e-07 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398278+0000", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0880000000000001e-05 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398285+0000", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3879999999999997e-06 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398289+0000", 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7210000000000002e-06 2024-09-12T21:51:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398327+0000", 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7808000000000001e-05 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.398342+0000", 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4956999999999999e-05 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47380 5.0 e30/21 5:0192a3cd:::benchmark_data_smithi053_32461_object47379:head v 30'2913, mlcod=30'2910)", 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.399587+0000", 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015899239999999999, 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020550049999999999, 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399587+0000", 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399587+0000", 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399587+0000", 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1199999999999998e-07 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399650+0000", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2817000000000005e-05 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399657+0000", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6000000000000003e-06 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.399662+0000", 2024-09-12T21:51:13.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0900000000000004e-06 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400125+0000", 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000462836 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400142+0000", 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7473e-05 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47382 5.3 5:c2c079c2:::benchmark_data_smithi053_32461_object47381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.400489+0000", 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00068783799999999997, 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001186739, 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47382 2024-09-12T21:51:13.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400489+0000", 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400489+0000", 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400490+0000", 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400552+0000", 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2267999999999994e-05 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400560+0000", 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4109999999999996e-06 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400565+0000", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.561e-06 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400609+0000", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4187999999999998e-05 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400746+0000", 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137236 2024-09-12T21:51:13.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.400886+0000", 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013959700000000001 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-09-12T21:51:13.468 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:13.470 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:13.471 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:13.468+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:13.570 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:13.569+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:13.661 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:13.661 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:13.661 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:13.661 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:13.661 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:13.672 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:13.670+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:13.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:13.772 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:13.771+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:13.864 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:18259 5.2 e25/21 5:4460e580:::benchmark_data_smithi053_32461_object18258:head v 25'1141, mlcod=25'1137)", 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.315715068999999, 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01482526, 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545703+0000", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0760999999999997e-05 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545722+0000", 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8606000000000001e-05 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545728+0000", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.285e-06 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551313+0000", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055852610000000002 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551331+0000", 2024-09-12T21:51:13.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7547e-05 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560433+0000", 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091016819999999998 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560477+0000", 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4400999999999997e-05 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:18262 5.c 5:3390dac7:::benchmark_data_smithi053_32461_object18261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.314538155999999, 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014099459, 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 18262 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546830+0000", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8700000000000004e-07 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546893+0000", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3465000000000003e-05 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546901+0000", 2024-09-12T21:51:13.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9019999999999999e-06 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546906+0000", 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551185+0000", 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042795699999999999 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551290+0000", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010442600000000001 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551438+0000", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014857 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.553548+0000", 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002109325 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560619+0000", 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070717169999999999 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560882+0000", 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026296799999999998 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560928+0000", 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5627999999999997e-05 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23644 5.6 5:61770153:::benchmark_data_smithi053_32461_object23643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7210858380000005, 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014971791, 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23644 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140282+0000", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140402+0000", 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-12T21:51:13.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140414+0000", 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140421+0000", 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7100000000000007e-06 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140865+0000", 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000443724 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140980+0000", 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115148 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141097+0000", 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116876 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142829+0000", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017317820000000001 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155134+0000", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012305015000000001 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155201+0000", 2024-09-12T21:51:13.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6802000000000002e-05 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155253+0000", 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2082e-05 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24518 5.3 5:ce09bda5:::benchmark_data_smithi053_32461_object24517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:13.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4568256379999998, 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01429952, 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24518 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404542+0000", 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405188+0000", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064633900000000001 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405198+0000", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3130000000000004e-06 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405204+0000", 2024-09-12T21:51:13.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379999999999996e-06 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405248+0000", 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.354e-05 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405356+0000", 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107532 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405486+0000", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130109 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409406+0000", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039201740000000002 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418737+0000", 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093307640000000001 2024-09-12T21:51:13.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418802+0000", 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5257000000000002e-05 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418841+0000", 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8824e-05 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24519 5.3 5:ce535336:::benchmark_data_smithi053_32461_object24518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4561489830000003, 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013759295, 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24519 2024-09-12T21:51:13.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405219+0000", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405249+0000", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405256+0000", 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2320000000000004e-06 2024-09-12T21:51:13.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405262+0000", 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7830000000000004e-06 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406483+0000", 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012208189999999999 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406574+0000", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1508999999999994e-05 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406659+0000", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4444999999999995e-05 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409429+0000", 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027704940000000001 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418893+0000", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094641670000000008 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418945+0000", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1697000000000003e-05 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418977+0000", 2024-09-12T21:51:13.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2199000000000001e-05 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33661 5.5 5:a785fdf9:::benchmark_data_smithi053_32461_object33660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.5202386519999997, 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014096894, 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33661 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341129+0000", 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341157+0000", 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8377999999999998e-05 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341164+0000", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2679999999999997e-06 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341171+0000", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0099999999999998e-06 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341217+0000", 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5893000000000003e-05 2024-09-12T21:51:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341355+0000", 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013802700000000001 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341480+0000", 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012479599999999999 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.343388+0000", 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019079190000000001 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355171+0000", 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011782892 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355203+0000", 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2038000000000001e-05 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355225+0000", 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2106000000000001e-05 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33981 5.a 5:5447de07:::benchmark_data_smithi053_32461_object33980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4009407339999997, 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013529405, 2024-09-12T21:51:13.901 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33981 2024-09-12T21:51:13.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.903 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460426+0000", 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460427+0000", 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0299999999999998e-07 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460519+0000", 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2363999999999999e-05 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460528+0000", 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.49e-06 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.460537+0000", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7620000000000007e-06 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.461981+0000", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001443338 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.462138+0000", 2024-09-12T21:51:13.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015754699999999999 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.462288+0000", 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014925 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.470215+0000", 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079274810000000001 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473898+0000", 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036824959999999999 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473931+0000", 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2944000000000002e-05 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.473955+0000", 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.493e-05 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:34088 5.2 e26/21 5:4e395165:::benchmark_data_smithi053_32461_object34087:head v 26'2154, mlcod=26'2151)", 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3572062279999999, 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599526, 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:13.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504378+0000", 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021676099999999999 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504384+0000", 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4529999999999999e-06 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504389+0000", 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505542+0000", 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001153081 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505561+0000", 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9737000000000001e-05 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520723+0000", 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015161604 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520760+0000", 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6992000000000001e-05 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34838 5.3 5:c4330a9f:::benchmark_data_smithi053_32461_object34837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0938790129999996, 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013876515000000001, 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34838 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:13.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767522+0000", 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3930000000000002e-05 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767531+0000", 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3890000000000005e-06 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767536+0000", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.967e-06 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772807+0000", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005271342 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772935+0000", 2024-09-12T21:51:13.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804299999999999 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.773070+0000", 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135007 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778166+0000", 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050958510000000002 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781281+0000", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031145729999999998 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781327+0000", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6582999999999998e-05 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781364+0000", 2024-09-12T21:51:13.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7200000000000003e-05 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34843 5.3 5:c19f014c:::benchmark_data_smithi053_32461_object34842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0923053109999996, 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015791453, 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34843 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769062+0000", 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8599999999999998e-07 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769180+0000", 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117528 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769188+0000", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769193+0000", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2909999999999998e-06 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775815+0000", 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066217089999999999 2024-09-12T21:51:13.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775962+0000", 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146761 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.776105+0000", 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143688 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778491+0000", 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023859549999999999 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784760+0000", 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062689449999999997 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784806+0000", 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6283999999999999e-05 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784853+0000", 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6437999999999998e-05 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:37415 5.c 5:3e514fbb:::benchmark_data_smithi053_32461_object37414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2127188230000003, 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013817528000000001, 2024-09-12T21:51:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 37415 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648649+0000", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648717+0000", 2024-09-12T21:51:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379000000000004e-05 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648726+0000", 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4010000000000003e-06 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648732+0000", 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9950000000000002e-06 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.651977+0000", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032444069999999999 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.652065+0000", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8387000000000006e-05 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.652153+0000", 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7793000000000005e-05 2024-09-12T21:51:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.653110+0000", 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095753199999999998 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662376+0000", 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009265222 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662434+0000", 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8121000000000001e-05 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662465+0000", 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1677000000000002e-05 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5216412909999999, 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.520319765, 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5198319219999998, 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5191045409999999, 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5133099840000002, 2024-09-12T21:51:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47093 5.a 5:560dc4f3:::benchmark_data_smithi053_32461_object47092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.570999492, 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013926518000000001, 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47093 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290368+0000", 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290449+0000", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1410999999999997e-05 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290457+0000", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3780000000000003e-06 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290462+0000", 2024-09-12T21:51:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1150000000000002e-06 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.297757+0000", 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072951489999999999 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.297880+0000", 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012316700000000001 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.298004+0000", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012419899999999999 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.302248+0000", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042435090000000003 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304206+0000", 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019578970000000001 2024-09-12T21:51:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304256+0000", 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0501000000000003e-05 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304294+0000", 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7437000000000001e-05 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47121 5.3 5:cbc49f71:::benchmark_data_smithi053_32461_object47120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.561432351, 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016851664999999998, 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47121 2024-09-12T21:51:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299935+0000", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299962+0000", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7509999999999999e-05 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299969+0000", 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8759999999999999e-06 2024-09-12T21:51:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299974+0000", 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7820000000000001e-06 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304878+0000", 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049039740000000002 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305020+0000", 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014202999999999999 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305174+0000", 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153917 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.310026+0000", 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00485192 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316699+0000", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00667331 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316746+0000", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6959000000000002e-05 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316786+0000", 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9920999999999999e-05 2024-09-12T21:51:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:47789 5.4 e30/21 5:2e259acd:::benchmark_data_smithi053_32461_object47788:head v 30'2999, mlcod=30'2995)", 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.544782+0000", 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.31658483900000001, 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013400314, 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544782+0000", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544782+0000", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544783+0000", 2024-09-12T21:51:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544838+0000", 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5528000000000001e-05 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544848+0000", 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.024e-05 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.544864+0000", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5423000000000001e-05 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.547173+0000", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023095770000000002 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.547188+0000", 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4272e-05 2024-09-12T21:51:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.558123+0000", 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010935456 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.558182+0000", 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9237999999999998e-05 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47888 5.c 5:3f27c83c:::benchmark_data_smithi053_32461_object47887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.27428194500000003, 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015402676000000001, 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47888 2024-09-12T21:51:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587086+0000", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587161+0000", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5415999999999998e-05 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587171+0000", 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0182e-05 2024-09-12T21:51:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587178+0000", 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8210000000000004e-06 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590776+0000", 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035977719999999999 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590868+0000", 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2153999999999999e-05 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590964+0000", 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5733e-05 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.599419+0000", 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084549250000000003 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602400+0000", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029818650000000002 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602452+0000", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1445e-05 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602488+0000", 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5629000000000001e-05 2024-09-12T21:51:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:13.987 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:13.988 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:13.987+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:13.989 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:14.089 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.089+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:14.131 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:49260 5.a e30/21 5:5e1979dc:::benchmark_data_smithi053_32461_object49259:head v 30'3026, mlcod=30'3024)", 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.124019+0000", 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058254750000000001, 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058533480000000004, 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124019+0000", 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124019+0000", 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124020+0000", 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5300000000000003e-07 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124089+0000", 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9682000000000001e-05 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124101+0000", 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1734e-05 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124108+0000", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7220000000000002e-06 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124162+0000", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4265999999999998e-05 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.124181+0000", 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8686e-05 2024-09-12T21:51:14.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49261 5.8 5:1f5448e3:::benchmark_data_smithi053_32461_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.127443+0000", 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002401074, 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002493824, 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49261 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127443+0000", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127443+0000", 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127444+0000", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127499+0000", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4444999999999998e-05 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127510+0000", 2024-09-12T21:51:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1049e-05 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127515+0000", 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8239999999999999e-06 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128068+0000", 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00055374700000000005 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128188+0000", 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011935200000000001 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128321+0000", 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013291099999999999 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49263 5.d 5:be76bd1f:::benchmark_data_smithi053_32461_object49262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.140 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.128324+0000", 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015204249999999999, 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001684496, 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49263 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128324+0000", 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128324+0000", 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128325+0000", 2024-09-12T21:51:14.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5199999999999996e-07 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128457+0000", 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013254599999999999 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128469+0000", 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1918e-05 2024-09-12T21:51:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128474+0000", 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6489999999999999e-06 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128523+0000", 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9394000000000002e-05 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128642+0000", 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119123 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128776+0000", 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013318100000000001 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.146 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49247 5.8 5:1c7f07cb:::benchmark_data_smithi053_32461_object49246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.117182+0000", 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.012662847, 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012897433, 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.147 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49247 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117182+0000", 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117182+0000", 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117182+0000", 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3099999999999997e-07 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117216+0000", 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3457000000000002e-05 2024-09-12T21:51:14.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117224+0000", 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0760000000000003e-06 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.117232+0000", 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8450000000000003e-06 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123160+0000", 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059286800000000004 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123276+0000", 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011579899999999999 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123406+0000", 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013002900000000001 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.127968+0000", 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045617160000000004 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130052+0000", 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002084191 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49265 5.0 5:0e431e95:::benchmark_data_smithi053_32461_object49264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.128492+0000", 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013526409999999999, 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001669404, 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49265 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128492+0000", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128492+0000", 2024-09-12T21:51:14.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128492+0000", 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9400000000000005e-07 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128617+0000", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012496799999999999 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128623+0000", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6080000000000003e-06 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128628+0000", 2024-09-12T21:51:14.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9080000000000003e-06 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130018+0000", 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013900710000000001 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130124+0000", 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105614 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49266 5.4 5:2fa807ca:::benchmark_data_smithi053_32461_object49265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.128635+0000", 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0012096209999999999, 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015900630000000001, 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49266 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128635+0000", 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128635+0000", 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128635+0000", 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6899999999999998e-07 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128791+0000", 2024-09-12T21:51:14.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015604599999999999 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128796+0000", 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8930000000000004e-06 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128800+0000", 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5719999999999999e-06 2024-09-12T21:51:14.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128839+0000", 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9347000000000001e-05 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128971+0000", 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013172300000000001 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129075+0000", 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010438300000000001 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49269 5.d 5:b8cb6058:::benchmark_data_smithi053_32461_object49268:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.128808+0000", 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010365249999999999, 2024-09-12T21:51:14.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014865600000000001, 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49269 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128808+0000", 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128808+0000", 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128808+0000", 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5900000000000002e-07 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128873+0000", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4117999999999998e-05 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128880+0000", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4250000000000001e-06 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128897+0000", 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7096999999999999e-05 2024-09-12T21:51:14.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130207+0000", 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013097619999999999 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49270 5.4 5:2a92b690:::benchmark_data_smithi053_32461_object49269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.128915+0000", 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00092919599999999997, 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001439978, 2024-09-12T21:51:14.167 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49270 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128915+0000", 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128915+0000", 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128916+0000", 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128954+0000", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8170999999999998e-05 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128963+0000", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3720000000000005e-06 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.128968+0000", 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7060000000000001e-06 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130250+0000", 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001281302 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4635.0:49271 5.a e30/21 5:5e133781:::benchmark_data_smithi053_32461_object49270:head v 30'3027, mlcod=30'3024)", 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.129075+0000", 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00076949699999999995, 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013392790000000001, 2024-09-12T21:51:14.171 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129075+0000", 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129075+0000", 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129076+0000", 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6400000000000002e-07 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129147+0000", 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1190000000000001e-05 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129154+0000", 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4939999999999997e-06 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129159+0000", 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.899e-06 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129198+0000", 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8427000000000003e-05 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.129211+0000", 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3338e-05 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4635.0:49258 5.0 e30/21)", 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.130249+0000", 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995956, 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000223267, 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130249+0000", 2024-09-12T21:51:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130249+0000", 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130249+0000", 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2900000000000004e-07 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130253+0000", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2200000000000001e-06 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130263+0000", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0360000000000001e-05 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130270+0000", 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7630000000000003e-06 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.178 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49257 5.b 5:d42d08ad:::benchmark_data_smithi053_32461_object49256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.123392+0000", 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.006452279, 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007132518, 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.179 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49257 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123392+0000", 2024-09-12T21:51:14.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123392+0000", 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123393+0000", 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6099999999999999e-07 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123500+0000", 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106783 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123511+0000", 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1139e-05 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123519+0000", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5700000000000004e-06 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125207+0000", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001688794 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125344+0000", 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136868 2024-09-12T21:51:14.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125471+0000", 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012653600000000001 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.130355+0000", 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004883737 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49258 5.0 5:06baee9b:::benchmark_data_smithi053_32461_object49257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.123536+0000", 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.006308503, 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070554459999999999, 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.185 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49258 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123536+0000", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123536+0000", 2024-09-12T21:51:14.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123537+0000", 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5899999999999996e-07 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123617+0000", 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0006000000000006e-05 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123626+0000", 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6220000000000004e-06 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123632+0000", 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0680000000000002e-06 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125037+0000", 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014043689999999999 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125151+0000", 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011479100000000001 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125271+0000", 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119707 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4635.0:49259 5.4 5:2af25be2:::benchmark_data_smithi053_32461_object49258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-09-12T21:51:14.123644+0000", 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0062007080000000001, 2024-09-12T21:51:14.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007050639, 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "continuous": false, 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4635", 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 49259 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123644+0000", 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123644+0000", 2024-09-12T21:51:14.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123644+0000", 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123677+0000", 2024-09-12T21:51:14.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2184000000000002e-05 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123685+0000", 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5450000000000003e-06 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.123691+0000", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7960000000000001e-06 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125029+0000", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001337881 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125151+0000", 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012237700000000001 2024-09-12T21:51:14.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-09-12T21:51:14.125286+0000", 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135263 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-09-12T21:51:14.196 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:14.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:14.198 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:14.196+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:14.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:14.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:51:14.298 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.297+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:14.344 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:51:14.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:51:14.344 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-09-12T21:51:14.344 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-09-12T21:51:14.344 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:51:14.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:14.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 15 16 49908 49892 207.866 165.188 0.00409898 0.00480804 2024-09-12T21:51:14.364 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:14.383 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:14.399 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.398+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:14.402 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:14.496 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:14.496 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:14.499 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.498+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:14.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:14.600 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.599+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:14.650 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:14.651 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:14.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:14.701 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:14.700+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:14.802 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:14.801+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:14.846 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:14.846 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:14.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:14.903 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:14.903+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.001 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.001 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.004 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:15.004+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:15.106 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:15.105+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.167 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.167 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:15.206 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:15.206+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.287 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:51:15.307 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:15.306+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:15.324 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.324 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:15.355 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 16 16 52480 52464 204.92 160.75 0.00565044 0.00487678 2024-09-12T21:51:15.409 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:15.408+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:15.488 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.488 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:51:15.509 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:15.508+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:15.610 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:15.609+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:15.643 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.643 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.654 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T21:51:15.711 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:15.710+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:15.812 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:15.811+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.839 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.840 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:15.851 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T21:51:15.913 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:15.912+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:15.991 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:15.991 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:16.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:16.046 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:16.045+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:16.115 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:16.114+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:16.147 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:16.147 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:16.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:16.215 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:16.214+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:16.316 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:16.315+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:16.345 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:16.345 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:16.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 17 16 54965 54949 202.001 155.312 0.00621842 0.00494734 2024-09-12T21:51:16.357 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:16.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:16.416 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:16.415+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:16.497 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:16.497 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:16.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:16.518 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:16.517+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:16.548 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:16.567 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:16.567 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:16.585 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:16.618 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:16.617+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:16.667 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:55731 5.3 5:c5117d06:::benchmark_data_smithi053_32461_object55730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.664051+0000", 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020580529999999998, 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020836299999999999, 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55731 2024-09-12T21:51:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664051+0000", 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664051+0000", 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664052+0000", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9600000000000008e-07 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664083+0000", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1325999999999998e-05 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664094+0000", 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.078e-05 2024-09-12T21:51:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664102+0000", 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3599999999999996e-06 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664150+0000", 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7487999999999997e-05 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664270+0000", 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120648 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664404+0000", 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133246 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:55733 5.5 5:aacf3e5c:::benchmark_data_smithi053_32461_object55732:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.664119+0000", 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019899280000000002, 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020927229999999999, 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55733 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664119+0000", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664119+0000", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664119+0000", 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:51:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664144+0000", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4783e-05 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664151+0000", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1949999999999997e-06 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664157+0000", 2024-09-12T21:51:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3149999999999999e-06 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664195+0000", 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8884000000000002e-05 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664308+0000", 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112827 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664429+0000", 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012044099999999999 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:55734 5.4 e31/21 5:2c246ffa:::benchmark_data_smithi053_32461_object55733:head v 31'3472, mlcod=31'3469)", 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.664166+0000", 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001942795, 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002113307, 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664166+0000", 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664166+0000", 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664167+0000", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664643+0000", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047663799999999999 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664653+0000", 2024-09-12T21:51:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664659+0000", 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665816+0000", 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011567789999999999 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665836+0000", 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9755999999999999e-05 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:55736 5.7 e31/21 5:e7935598:::benchmark_data_smithi053_32461_object55735:head v 31'3493, mlcod=31'3490)", 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.664754+0000", 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013543540000000001, 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015780589999999999, 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664754+0000", 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664754+0000", 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664755+0000", 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6899999999999998e-07 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664803+0000", 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7806999999999998e-05 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664811+0000", 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.664816+0000", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0950000000000003e-06 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665565+0000", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074868799999999996 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665584+0000", 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:55735 5.4 e31/21)", 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.665654+0000", 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00045486300000000001, 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00072867400000000001, 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665654+0000", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665654+0000", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665654+0000", 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9699999999999996e-07 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665721+0000", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6048000000000002e-05 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665729+0000", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7239999999999998e-06 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665735+0000", 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.711e-06 2024-09-12T21:51:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:55721 5.c 5:3e681576:::benchmark_data_smithi053_32461_object55720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.656101+0000", 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010008009, 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010329842000000001, 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55721 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656101+0000", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656101+0000", 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656101+0000", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5099999999999999e-07 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656171+0000", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9469999999999997e-05 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656179+0000", 2024-09-12T21:51:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4989999999999994e-06 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.656187+0000", 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2189999999999998e-06 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.660606+0000", 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044194769999999998 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.660717+0000", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110622 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.660818+0000", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100827 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.665837+0000", 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050191000000000003 2024-09-12T21:51:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:55725 5.4 e31/21 5:233c33ad:::benchmark_data_smithi053_32461_object55724:head v 31'3471, mlcod=31'3467)", 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.661129+0000", 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049796839999999998, 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053730649999999998, 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661129+0000", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661129+0000", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661130+0000", 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0399999999999996e-07 2024-09-12T21:51:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661251+0000", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121767 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661261+0000", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045e-05 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661270+0000", 2024-09-12T21:51:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6559999999999998e-06 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661311+0000", 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1227999999999999e-05 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661328+0000", 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6639000000000001e-05 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:55728 5.c 5:3dc16fed:::benchmark_data_smithi053_32461_object55727:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.661263+0000", 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048458199999999998, 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005297576, 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55728 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661263+0000", 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661263+0000", 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661264+0000", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4700000000000001e-07 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661341+0000", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7809e-05 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661352+0000", 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0771000000000001e-05 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.661365+0000", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699e-05 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662657+0000", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001291684 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662781+0000", 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012483500000000001 2024-09-12T21:51:16.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662943+0000", 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161698 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:55729 5.7 e31/21 5:e10236b6:::benchmark_data_smithi053_32461_object55728:head v 31'3492, mlcod=31'3490)", 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.662765+0000", 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003343394, 2024-09-12T21:51:16.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003859449, 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662765+0000", 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662765+0000", 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:16.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662766+0000", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8100000000000002e-07 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662800+0000", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4220000000000001e-05 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662810+0000", 2024-09-12T21:51:16.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9480000000000003e-06 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662816+0000", 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8510000000000004e-06 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662866+0000", 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0303000000000003e-05 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:16.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.662882+0000", 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6084999999999999e-05 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-09-12T21:51:16.705 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:16.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:16.719 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:16.718+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:16.820 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:51:16.819+0000 7f0937f52640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30498) UID: 0 2024-09-12T21:51:16.890 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:16.890 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:16.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:16.921 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:16.920+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:17.022 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:17.021+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:17.061 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:17.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:18259 5.2 e25/21 5:4460e580:::benchmark_data_smithi053_32461_object18258:head v 25'1141, mlcod=25'1137)", 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.512190605000001, 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01482526, 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545652+0000", 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545703+0000", 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0760999999999997e-05 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545722+0000", 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8606000000000001e-05 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.545728+0000", 2024-09-12T21:51:17.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.285e-06 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551313+0000", 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055852610000000002 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551331+0000", 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7547e-05 2024-09-12T21:51:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560433+0000", 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091016819999999998 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560477+0000", 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4400999999999997e-05 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:18262 5.c 5:3390dac7:::benchmark_data_smithi053_32461_object18261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:17.068 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.511013692000001, 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014099459, 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 18262 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546829+0000", 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546830+0000", 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8700000000000004e-07 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546893+0000", 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3465000000000003e-05 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546901+0000", 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9019999999999999e-06 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.546906+0000", 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551185+0000", 2024-09-12T21:51:17.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042795699999999999 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551290+0000", 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010442600000000001 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.551438+0000", 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014857 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.553548+0000", 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002109325 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560619+0000", 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070717169999999999 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560882+0000", 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026296799999999998 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:03.560928+0000", 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5627999999999997e-05 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:23644 5.6 5:61770153:::benchmark_data_smithi053_32461_object23643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.917561374, 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014971791, 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 23644 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140281+0000", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140282+0000", 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140402+0000", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140414+0000", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623e-05 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140421+0000", 2024-09-12T21:51:17.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7100000000000007e-06 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140865+0000", 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000443724 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.140980+0000", 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115148 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.141097+0000", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116876 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.142829+0000", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017317820000000001 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155134+0000", 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012305015000000001 2024-09-12T21:51:17.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155201+0000", 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6802000000000002e-05 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.155253+0000", 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2082e-05 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24518 5.3 5:ce09bda5:::benchmark_data_smithi053_32461_object24517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.653301173999999, 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01429952, 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24518 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404541+0000", 2024-09-12T21:51:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.404542+0000", 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405188+0000", 2024-09-12T21:51:17.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064633900000000001 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405198+0000", 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3130000000000004e-06 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405204+0000", 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379999999999996e-06 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405248+0000", 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.354e-05 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405356+0000", 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107532 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405486+0000", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130109 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409406+0000", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039201740000000002 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418737+0000", 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093307640000000001 2024-09-12T21:51:17.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418802+0000", 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5257000000000002e-05 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418841+0000", 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8824e-05 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:24519 5.3 5:ce535336:::benchmark_data_smithi053_32461_object24518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.652624519, 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013759295, 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 24519 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405218+0000", 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405219+0000", 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405249+0000", 2024-09-12T21:51:17.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405256+0000", 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2320000000000004e-06 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.405262+0000", 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7830000000000004e-06 2024-09-12T21:51:17.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406483+0000", 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012208189999999999 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406574+0000", 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1508999999999994e-05 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.406659+0000", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4444999999999995e-05 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.409429+0000", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027704940000000001 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418893+0000", 2024-09-12T21:51:17.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094641670000000008 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418945+0000", 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1697000000000003e-05 2024-09-12T21:51:17.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:05.418977+0000", 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2199000000000001e-05 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:33661 5.5 5:a785fdf9:::benchmark_data_smithi053_32461_object33660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7167141879999992, 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014096894, 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 33661 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341128+0000", 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341129+0000", 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341157+0000", 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8377999999999998e-05 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341164+0000", 2024-09-12T21:51:17.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2679999999999997e-06 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341171+0000", 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0099999999999998e-06 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341217+0000", 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5893000000000003e-05 2024-09-12T21:51:17.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341355+0000", 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013802700000000001 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.341480+0000", 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012479599999999999 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.343388+0000", 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019079190000000001 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355171+0000", 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011782892 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355203+0000", 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2038000000000001e-05 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.355225+0000", 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2106000000000001e-05 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:34088 5.2 e26/21 5:4e395165:::benchmark_data_smithi053_32461_object34087:head v 26'2154, mlcod=26'2151)", 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.5536817640000002, 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599526, 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504378+0000", 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021676099999999999 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504384+0000", 2024-09-12T21:51:17.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4529999999999999e-06 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504389+0000", 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505542+0000", 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001153081 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505561+0000", 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9737000000000001e-05 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520723+0000", 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015161604 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520760+0000", 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6992000000000001e-05 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34838 5.3 5:c4330a9f:::benchmark_data_smithi053_32461_object34837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2903545489999999, 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013876515000000001, 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34838 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767488+0000", 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767522+0000", 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3930000000000002e-05 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767531+0000", 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3890000000000005e-06 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.767536+0000", 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.967e-06 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772807+0000", 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005271342 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.772935+0000", 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804299999999999 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.773070+0000", 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135007 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778166+0000", 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050958510000000002 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781281+0000", 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031145729999999998 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781327+0000", 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6582999999999998e-05 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.781364+0000", 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7200000000000003e-05 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34843 5.3 5:c19f014c:::benchmark_data_smithi053_32461_object34842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.288780847, 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015791453, 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34843 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:17.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769062+0000", 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8599999999999998e-07 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769180+0000", 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117528 2024-09-12T21:51:17.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769188+0000", 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769193+0000", 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2909999999999998e-06 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775815+0000", 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066217089999999999 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775962+0000", 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146761 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.776105+0000", 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143688 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778491+0000", 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023859549999999999 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784760+0000", 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062689449999999997 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784806+0000", 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6283999999999999e-05 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784853+0000", 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6437999999999998e-05 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:37415 5.c 5:3e514fbb:::benchmark_data_smithi053_32461_object37414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:17.127 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4091943589999998, 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013817528000000001, 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 37415 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648648+0000", 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648649+0000", 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648717+0000", 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8379000000000004e-05 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648726+0000", 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4010000000000003e-06 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.648732+0000", 2024-09-12T21:51:17.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9950000000000002e-06 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.651977+0000", 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032444069999999999 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.652065+0000", 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8387000000000006e-05 2024-09-12T21:51:17.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.652153+0000", 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7793000000000005e-05 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.653110+0000", 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095753199999999998 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662376+0000", 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009265222 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662434+0000", 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8121000000000001e-05 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:09.662465+0000", 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1677000000000002e-05 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7181168270000002, 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:17.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:17.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:17.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7167953010000003, 2024-09-12T21:51:17.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:17.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:17.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:17.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7163074580000002, 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:17.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:17.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7155800770000003, 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:17.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:17.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:17.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.162 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7097855199999996, 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:17.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:17.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:17.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47093 5.a 5:560dc4f3:::benchmark_data_smithi053_32461_object47092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7674750279999998, 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013926518000000001, 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47093 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:17.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290367+0000", 2024-09-12T21:51:17.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290368+0000", 2024-09-12T21:51:17.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290449+0000", 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1410999999999997e-05 2024-09-12T21:51:17.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290457+0000", 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3780000000000003e-06 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.290462+0000", 2024-09-12T21:51:17.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1150000000000002e-06 2024-09-12T21:51:17.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.297757+0000", 2024-09-12T21:51:17.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072951489999999999 2024-09-12T21:51:17.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.297880+0000", 2024-09-12T21:51:17.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012316700000000001 2024-09-12T21:51:17.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.298004+0000", 2024-09-12T21:51:17.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012419899999999999 2024-09-12T21:51:17.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.302248+0000", 2024-09-12T21:51:17.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042435090000000003 2024-09-12T21:51:17.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304206+0000", 2024-09-12T21:51:17.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019578970000000001 2024-09-12T21:51:17.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304256+0000", 2024-09-12T21:51:17.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0501000000000003e-05 2024-09-12T21:51:17.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304294+0000", 2024-09-12T21:51:17.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7437000000000001e-05 2024-09-12T21:51:17.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.185 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47121 5.3 5:cbc49f71:::benchmark_data_smithi053_32461_object47120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.185 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:17.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.757907887, 2024-09-12T21:51:17.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016851664999999998, 2024-09-12T21:51:17.186 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.187 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47121 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:17.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299935+0000", 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299962+0000", 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7509999999999999e-05 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299969+0000", 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8759999999999999e-06 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299974+0000", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7820000000000001e-06 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304878+0000", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049039740000000002 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305020+0000", 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014202999999999999 2024-09-12T21:51:17.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305174+0000", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153917 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.310026+0000", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00485192 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316699+0000", 2024-09-12T21:51:17.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00667331 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316746+0000", 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6959000000000002e-05 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316786+0000", 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9920999999999999e-05 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47888 5.c 5:3f27c83c:::benchmark_data_smithi053_32461_object47887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.4707574810000001, 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015402676000000001, 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47888 2024-09-12T21:51:17.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587086+0000", 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587161+0000", 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5415999999999998e-05 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587171+0000", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0182e-05 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587178+0000", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8210000000000004e-06 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590776+0000", 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035977719999999999 2024-09-12T21:51:17.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590868+0000", 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2153999999999999e-05 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590964+0000", 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5733e-05 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.599419+0000", 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084549250000000003 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602400+0000", 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029818650000000002 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602452+0000", 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1445e-05 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602488+0000", 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5629000000000001e-05 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:48618 5.5 5:ac885ee9:::benchmark_data_smithi053_32461_object48617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.884880+0000", 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.1729622969999998, 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014047979, 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48618 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884880+0000", 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884880+0000", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884881+0000", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3900000000000005e-07 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884909+0000", 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8753000000000001e-05 2024-09-12T21:51:17.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884917+0000", 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7060000000000004e-06 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.884924+0000", 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7410000000000003e-06 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.886706+0000", 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017822809999999999 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.886828+0000", 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122057 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.886970+0000", 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014199699999999999 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.890254+0000", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032841889999999999 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.898863+0000", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086088669999999992 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.898905+0000", 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1607999999999999e-05 2024-09-12T21:51:17.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.898928+0000", 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3241e-05 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:56037 5.5 5:a7b38603:::benchmark_data_smithi053_32461_object56036:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:16.790708+0000", 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.26713406499999998, 2024-09-12T21:51:17.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014243607, 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56037 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790708+0000", 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790708+0000", 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790709+0000", 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0720000000000001e-06 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:17.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790865+0000", 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015598599999999999 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790875+0000", 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013e-05 2024-09-12T21:51:17.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790883+0000", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1810000000000004e-06 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.790935+0000", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2268999999999997e-05 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.791059+0000", 2024-09-12T21:51:17.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012372800000000001 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.791184+0000", 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012538600000000001 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.793767+0000", 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002582595 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.804848+0000", 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011081672000000001 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.804907+0000", 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8323999999999999e-05 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:16.804952+0000", 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5263999999999999e-05 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:17.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:17.213 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:17.213 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T21:51:17.213 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T21:51:17.213 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-09-12T21:51:17.214 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:51:17.214 INFO:teuthology.orchestra.console.smithi172:Power off 2024-09-12T21:51:17.214 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T21:51:17.228 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:17.213+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:17.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:17.241 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-09-12T21:51:17.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:51:17.315 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:17.314+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:17.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 18 16 57401 57385 199.236 152.25 0.00552243 0.00501587 2024-09-12T21:51:17.369 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57418 5.f 5:f07c6e5a:::benchmark_data_smithi053_32461_object57417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.362283+0000", 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0056742779999999996, 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005700948, 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57418 2024-09-12T21:51:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362283+0000", 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362283+0000", 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362284+0000", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1299999999999999e-07 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362351+0000", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7127999999999998e-05 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362361+0000", 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.06e-05 2024-09-12T21:51:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.362369+0000", 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4880000000000001e-06 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363796+0000", 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014271080000000001 2024-09-12T21:51:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363891+0000", 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5029000000000001e-05 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363967+0000", 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6099000000000004e-05 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57419 5.9 5:9fcfff96:::benchmark_data_smithi053_32461_object57418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.363026+0000", 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0049311449999999996, 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050441219999999998, 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57419 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363026+0000", 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363026+0000", 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363027+0000", 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363113+0000", 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6148000000000003e-05 2024-09-12T21:51:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363121+0000", 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1519999999999992e-06 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363126+0000", 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9799999999999998e-06 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363171+0000", 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5306999999999998e-05 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363299+0000", 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012759199999999999 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.363439+0000", 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014017200000000001 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57422 5.f 5:fa97b7c4:::benchmark_data_smithi053_32461_object57421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.364872+0000", 2024-09-12T21:51:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0030850539999999998, 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032780579999999999, 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57422 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364872+0000", 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364872+0000", 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364873+0000", 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.23e-07 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364959+0000", 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6574000000000002e-05 2024-09-12T21:51:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364968+0000", 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9490000000000002e-06 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.364979+0000", 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0713000000000001e-05 2024-09-12T21:51:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365185+0000", 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020598200000000001 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365275+0000", 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0004000000000001e-05 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365385+0000", 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011026 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57425 5.2 5:414aa551:::benchmark_data_smithi053_32461_object57424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.365051+0000", 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002906526, 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031793099999999999, 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57425 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365051+0000", 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365051+0000", 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365051+0000", 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2099999999999996e-07 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365196+0000", 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144921 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365209+0000", 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3269e-05 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365219+0000", 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3770000000000002e-06 2024-09-12T21:51:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365271+0000", 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1715999999999997e-05 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365380+0000", 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010995 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365504+0000", 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000123924 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57426 5.1 5:8672b8f6:::benchmark_data_smithi053_32461_object57425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.365238+0000", 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027193830000000001, 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030346650000000002, 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57426 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365238+0000", 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365238+0000", 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365238+0000", 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1900000000000002e-07 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365269+0000", 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0369999999999999e-05 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365278+0000", 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.918e-06 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365284+0000", 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2020000000000001e-06 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365328+0000", 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3958000000000002e-05 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365445+0000", 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011718 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365580+0000", 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013484400000000001 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57427 5.7 5:e6b56457:::benchmark_data_smithi053_32461_object57426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.365299+0000", 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0026578109999999999, 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030116740000000002, 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57427 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365299+0000", 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365299+0000", 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365300+0000", 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4899999999999995e-07 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365335+0000", 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4856e-05 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365343+0000", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4940000000000003e-06 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365350+0000", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0110000000000003e-06 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.366069+0000", 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00071854099999999995 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.366182+0000", 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113285 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.366310+0000", 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012806699999999999 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57428 5.1 5:8a810b35:::benchmark_data_smithi053_32461_object57427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.365362+0000", 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002595052, 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029885559999999999, 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57428 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365362+0000", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365362+0000", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365363+0000", 2024-09-12T21:51:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365387+0000", 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4559999999999999e-05 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365395+0000", 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7079999999999997e-06 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365401+0000", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3210000000000001e-06 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367444+0000", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020430470000000001 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367567+0000", 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000122287 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367691+0000", 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000124015 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57430 5.1 5.8737e8b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.365452+0000", 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025051800000000001, 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029341469999999998, 2024-09-12T21:51:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57430 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365452+0000", 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365452+0000", 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365453+0000", 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7199999999999998e-07 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365478+0000", 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5758e-05 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365488+0000", 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5130000000000002e-06 2024-09-12T21:51:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.365494+0000", 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1670000000000004e-06 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:57423 5.5 e31/21 5:a648f400:::benchmark_data_smithi053_32461_object57422:head v 31'3555, mlcod=31'3552)", 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.367366+0000", 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00059099100000000002, 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010483739999999999, 2024-09-12T21:51:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367366+0000", 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367366+0000", 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367367+0000", 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6599999999999996e-07 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367427+0000", 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0438e-05 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367440+0000", 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2857000000000001e-05 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367445+0000", 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5470000000000004e-06 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367536+0000", 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0984999999999997e-05 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367558+0000", 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1097000000000001e-05 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:57431 5.6 e31/21 5:623315aa:::benchmark_data_smithi053_32461_object57430:head v 31'3601, mlcod=31'3599)", 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.367468+0000", 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00048882999999999999, 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00098273099999999993, 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367468+0000", 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367468+0000", 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367469+0000", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.72e-07 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367502+0000", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3636000000000001e-05 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367519+0000", 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6847e-05 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367527+0000", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3410000000000003e-06 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367581+0000", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3350999999999998e-05 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367596+0000", 2024-09-12T21:51:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5557e-05 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57433 5.f 5:f5cbcf00:::benchmark_data_smithi053_32461_object57432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.367758+0000", 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00019927700000000001, 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00072498199999999999, 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57433 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367758+0000", 2024-09-12T21:51:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367758+0000", 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367759+0000", 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5700000000000001e-07 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367803+0000", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4712999999999997e-05 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367823+0000", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0046000000000001e-05 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367842+0000", 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8964e-05 2024-09-12T21:51:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367915+0000", 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2639999999999996e-05 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368037+0000", 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012171399999999999 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368112+0000", 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5145e-05 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57434 5.9 5.894feb59 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.367909+0000", 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.7862999999999999e-05, 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00060903699999999999, 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57434 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367909+0000", 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367909+0000", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367910+0000", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5700000000000001e-07 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367973+0000", 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3095000000000005e-05 2024-09-12T21:51:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367983+0000", 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-05 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.367990+0000", 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2720000000000003e-06 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:57425 5.2 e31/21)", 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.368504+0000", 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9994526, 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3997000000000004e-05, 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368504+0000", 2024-09-12T21:51:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368504+0000", 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368505+0000", 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.99e-07 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368508+0000", 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3909999999999998e-06 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368518+0000", 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0013999999999999e-05 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368524+0000", 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9000000000000003e-06 2024-09-12T21:51:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.368567+0000", 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2976999999999999e-05 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 13 2024-09-12T21:51:17.435 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:17.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:17.437 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:17.436+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:17.537 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:17.537+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:17.615 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:17.615 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:17.615 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:17.615 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:17.615 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:17.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:17.638 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:17.637+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:17.739 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:17.738+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:18259 5.2 5:4460e580:::benchmark_data_smithi053_32461_object18258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.263660873999999, 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015716200999999999, 2024-09-12T21:51:17.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 18259 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544941+0000", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544942+0000", 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7300000000000001e-07 2024-09-12T21:51:17.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.544996+0000", 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3995000000000001e-05 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545001+0000", 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545005+0000", 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.546e-06 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545379+0000", 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00037468100000000003 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545480+0000", 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101196 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.545561+0000", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0630000000000006e-05 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.547246+0000", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001685211 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560600+0000", 2024-09-12T21:51:17.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.013353535 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560633+0000", 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2703000000000002e-05 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:03.560657+0000", 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4814999999999999e-05 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.818 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:33660 5.1 5:8493626d:::benchmark_data_smithi053_32461_object33659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.4678915920000009, 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015436170000000001, 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.819 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 33660 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340710+0000", 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340711+0000", 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4499999999999996e-07 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340757+0000", 2024-09-12T21:51:17.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5770999999999999e-05 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340775+0000", 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7881e-05 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.340782+0000", 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.342899+0000", 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021175199999999999 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.343016+0000", 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117235 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.343141+0000", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012494900000000001 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.348967+0000", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058254759999999996 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356090+0000", 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0071233310000000001 2024-09-12T21:51:17.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356122+0000", 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1551999999999999e-05 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.356147+0000", 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4987e-05 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.825 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:34088 5.2 5:4e395165:::benchmark_data_smithi053_32461_object34087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.3055404050000003, 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907631, 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.826 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34088 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503123+0000", 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1043999999999994e-05 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503134+0000", 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0159999999999999e-05 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503140+0000", 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503822+0000", 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00068234899999999995 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503929+0000", 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107324 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.504049+0000", 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120228 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.506076+0000", 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020266759999999998 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520873+0000", 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01479723 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520928+0000", 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4268999999999998e-05 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520969+0000", 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1650999999999998e-05 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.833 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:36611 5.f 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.4370024679999993, 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017415061999999999, 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.834 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 36611 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371654+0000", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4367999999999999e-05 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371662+0000", 2024-09-12T21:51:17.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371667+0000", 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-06 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374826+0000", 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031582749999999999 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.837 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374938+0000", 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111957 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.375059+0000", 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121073 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.377750+0000", 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026908750000000001 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388919+0000", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011169231 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388974+0000", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5612000000000002e-05 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.389015+0000", 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0145000000000003e-05 2024-09-12T21:51:17.839 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4762467509999997, 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.840 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:17.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4759741829999999, 2024-09-12T21:51:17.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:17.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:17.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4759162579999998, 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.474844289, 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.859 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:17.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:17.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4712957079999995, 2024-09-12T21:51:17.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:17.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:17.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4699785539999999, 2024-09-12T21:51:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:17.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:17.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4696244790000002, 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:17.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4690166490000003, 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.882 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:17.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:17.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:17.886 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4689972070000001, 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:17.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4682907140000001, 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:17.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:17.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:48278 5.2 5:4b8746c9:::benchmark_data_smithi053_32461_object48277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:13.744840+0000", 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.0637624880000001, 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015265480999999999, 2024-09-12T21:51:17.895 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 48278 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744840+0000", 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744840+0000", 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744840+0000", 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744874+0000", 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3736999999999999e-05 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744881+0000", 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4789999999999999e-06 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.744887+0000", 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4439999999999999e-06 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.746449+0000", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015620709999999999 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.746532+0000", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3628000000000006e-05 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.746617+0000", 2024-09-12T21:51:17.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4190999999999994e-05 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.749214+0000", 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002597584 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.760044+0000", 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010829365000000001 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.760075+0000", 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.154e-05 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.760105+0000", 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9861000000000001e-05 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:48934 5.f 5:faa51b87:::benchmark_data_smithi053_32461_object48933:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:13.996880+0000", 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.8117222320000002, 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016239689000000002, 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 48934 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996880+0000", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996880+0000", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996880+0000", 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:17.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996964+0000", 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3261000000000001e-05 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996971+0000", 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0180000000000004e-06 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:13.996975+0000", 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.001364+0000", 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043892829999999999 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.001487+0000", 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012343599999999999 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.001618+0000", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013049599999999999 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.003627+0000", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002008859 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.013064+0000", 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0094367440000000004 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.013096+0000", 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2279e-05 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:14.013119+0000", 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3638e-05 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:55698 5.7 5:e85b9a0a:::benchmark_data_smithi053_32461_object55697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.164816614, 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016727028000000001, 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 55698 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643786+0000", 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643874+0000", 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7808999999999999e-05 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643880+0000", 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2210000000000002e-06 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643884+0000", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9779999999999999e-06 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647031+0000", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003147066 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647151+0000", 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120487 2024-09-12T21:51:17.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647298+0000", 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014635599999999999 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.648722+0000", 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014237570000000001 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660426+0000", 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011704674 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660470+0000", 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4005000000000003e-05 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660512+0000", 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2227000000000001e-05 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.913 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57058 5.7 5:e224e9e2:::benchmark_data_smithi053_32461_object57057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.207123+0000", 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.60147867899999996, 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015559701, 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.914 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57058 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207123+0000", 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207123+0000", 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207124+0000", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4899999999999995e-07 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207226+0000", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010223899999999999 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207234+0000", 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4139999999999997e-06 2024-09-12T21:51:17.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.207238+0000", 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.459e-06 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.209904+0000", 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026658390000000001 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.210006+0000", 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010196099999999999 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.210082+0000", 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6001999999999995e-05 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.215844+0000", 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057625630000000001 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.222629+0000", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0067846950000000003 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.222659+0000", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9649e-05 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.222683+0000", 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4230999999999999e-05 2024-09-12T21:51:17.919 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:57374 5.f 5:f1439770:::benchmark_data_smithi053_32461_object57373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.338980+0000", 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.46962199300000002, 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015352528000000001, 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.920 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 57374 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.338980+0000", 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.338980+0000", 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.338981+0000", 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999995e-07 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.339040+0000", 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9222999999999999e-05 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.339048+0000", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.276e-06 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.339053+0000", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5929999999999999e-06 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.341367+0000", 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023137610000000001 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.341452+0000", 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5554000000000001e-05 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.341567+0000", 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114541 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.345976+0000", 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044092929999999999 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.354240+0000", 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.008263889 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.354291+0000", 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1431000000000003e-05 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.354333+0000", 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1239000000000003e-05 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:58176 5.1 5:84d94b33:::benchmark_data_smithi053_32461_object58175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:17.677797+0000", 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.13080504700000001, 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015163370000000001, 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:17.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 58176 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677797+0000", 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677797+0000", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677797+0000", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9200000000000001e-07 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677831+0000", 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3197000000000001e-05 2024-09-12T21:51:17.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677838+0000", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5920000000000003e-06 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.677845+0000", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7689999999999999e-06 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.682194+0000", 2024-09-12T21:51:17.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043492899999999996 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.682341+0000", 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014642100000000001 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.682485+0000", 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144222 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.688189+0000", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057040019999999997 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.692872+0000", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046833689999999997 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.692923+0000", 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0492999999999999e-05 2024-09-12T21:51:17.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:17.692960+0000", 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7523e-05 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:17.932 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:17.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:17.934 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:17.933+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.034 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.034+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59141 5.5 5:a6cb259c:::benchmark_data_smithi053_32461_object59140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.085885+0000", 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011948379999999999, 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012137700000000001, 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59141 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085885+0000", 2024-09-12T21:51:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085885+0000", 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085885+0000", 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7300000000000005e-07 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085960+0000", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4300000000000004e-05 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085970+0000", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426e-05 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085975+0000", 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.741e-06 2024-09-12T21:51:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086016+0000", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1384000000000002e-05 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086202+0000", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185816 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086336+0000", 2024-09-12T21:51:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134237 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59139 5.0 e31/21 5:0d9a74f0:::benchmark_data_smithi053_32461_object59138:head v 31'3682, mlcod=31'3679)", 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.085903+0000", 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011764970000000001, 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001240393, 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085903+0000", 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085903+0000", 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085903+0000", 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5199999999999998e-07 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086002+0000", 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8698999999999998e-05 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086008+0000", 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6189999999999999e-06 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086012+0000", 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9179999999999996e-06 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086051+0000", 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9650999999999997e-05 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086069+0000", 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7336000000000001e-05 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59142 5.b e31/21 5:dfc105ab:::benchmark_data_smithi053_32461_object59141:head v 31'3602, mlcod=31'3600)", 2024-09-12T21:51:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.086376+0000", 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000703223, 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000798083, 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086376+0000", 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086376+0000", 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086377+0000", 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999996e-07 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086446+0000", 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.915e-05 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086459+0000", 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2632999999999999e-05 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086463+0000", 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7960000000000003e-06 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086507+0000", 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3430000000000003e-05 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086525+0000", 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7830999999999999e-05 2024-09-12T21:51:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59143 5.7 e31/21 5:e16ed687:::benchmark_data_smithi053_32461_object59142:head v 31'3704, mlcod=31'3702)", 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.086604+0000", 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00047560000000000001, 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059990900000000003, 2024-09-12T21:51:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086604+0000", 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086604+0000", 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086604+0000", 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2099999999999997e-07 2024-09-12T21:51:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086627+0000", 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2442e-05 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086636+0000", 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0680000000000003e-06 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086641+0000", 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1680000000000003e-06 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086690+0000", 2024-09-12T21:51:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8517999999999999e-05 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086707+0000", 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7774e-05 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59127 5.a 5:598663d2:::benchmark_data_smithi053_32461_object59126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.079785+0000", 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0072948420000000002, 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074538909999999998, 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59127 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079785+0000", 2024-09-12T21:51:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079785+0000", 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079785+0000", 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079808+0000", 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3247999999999998e-05 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079817+0000", 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079823+0000", 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9200000000000001e-06 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079872+0000", 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9628e-05 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.079987+0000", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114462 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.080109+0000", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122528 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084849+0000", 2024-09-12T21:51:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047398750000000002 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59131 5.a 5:5b21d2ea:::benchmark_data_smithi053_32461_object59130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.081379+0000", 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005700447, 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059027259999999996, 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59131 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081379+0000", 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081379+0000", 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081380+0000", 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1699999999999997e-07 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081497+0000", 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116846 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081505+0000", 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4139999999999994e-06 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081512+0000", 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5030000000000002e-06 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082445+0000", 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093379800000000001 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082592+0000", 2024-09-12T21:51:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014620799999999999 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082737+0000", 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014544800000000001 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085185+0000", 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024477460000000002 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59129 5.0 e31/21 5:0a9506e7:::benchmark_data_smithi053_32461_object59128:head v 31'3681, mlcod=31'3678)", 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.081538+0000", 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055413449999999996, 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058007509999999998, 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081538+0000", 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081538+0000", 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081539+0000", 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.34e-07 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081603+0000", 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4232000000000004e-05 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081610+0000", 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081616+0000", 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.93e-06 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081678+0000", 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1875e-05 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081695+0000", 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6741000000000001e-05 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59130 5.8 e31/21 5:15213838:::benchmark_data_smithi053_32461_object59129:head v 31'3808, mlcod=31'3806)", 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.081861+0000", 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052187249999999996, 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055378570000000002, 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081861+0000", 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081861+0000", 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081866+0000", 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2830000000000001e-06 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081928+0000", 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1978999999999997e-05 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081937+0000", 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7970000000000006e-06 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.081943+0000", 2024-09-12T21:51:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5060000000000001e-06 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082179+0000", 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023590800000000001 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082199+0000", 2024-09-12T21:51:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9728000000000002e-05 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59133 5.6 5:658c0209:::benchmark_data_smithi053_32461_object59132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.082458+0000", 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046212290000000001, 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050032419999999998, 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59133 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082458+0000", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082458+0000", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082459+0000", 2024-09-12T21:51:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.16e-07 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082484+0000", 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5244000000000001e-05 2024-09-12T21:51:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082499+0000", 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.454e-05 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082505+0000", 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3949999999999998e-06 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082849+0000", 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034400099999999997 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.082976+0000", 2024-09-12T21:51:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126594 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.083121+0000", 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145317 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.086076+0000", 2024-09-12T21:51:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029547699999999998 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59137 5.8 e31/21 5:10076a91:::benchmark_data_smithi053_32461_object59136:head v 31'3809, mlcod=31'3806)", 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.084450+0000", 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026297040000000001, 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030890639999999999, 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084450+0000", 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084450+0000", 2024-09-12T21:51:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084450+0000", 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084510+0000", 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9389999999999999e-05 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084519+0000", 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5910000000000002e-06 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084525+0000", 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-06 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084572+0000", 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7104000000000002e-05 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.084593+0000", 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0463e-05 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:59138 5.2 e31/21 5:481581fb:::benchmark_data_smithi053_32461_object59137:head v 31'3622, mlcod=31'3620)", 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.085326+0000", 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001753583, 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022707700000000001, 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085326+0000", 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085326+0000", 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085327+0000", 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:18.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085384+0000", 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7349000000000003e-05 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085392+0000", 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8769999999999993e-06 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085396+0000", 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.741e-06 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085442+0000", 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145000000000002e-05 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.085461+0000", 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9862999999999999e-05 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:51:18.151 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:18.153 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.152+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:18.254 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:18.252+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:51:18.310 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:18.311 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:18.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:18.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 19 16 59792 59776 196.614 149.438 0.00520082 0.00508333 2024-09-12T21:51:18.435 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:18.365+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:18.455 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.454+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.556 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.556+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.584 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:34088 5.2 e26/21 5:4e395165:::benchmark_data_smithi053_32461_object34087:head v 26'2154, mlcod=26'2151)", 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.076742836999999, 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599526, 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504378+0000", 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021676099999999999 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504384+0000", 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4529999999999999e-06 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504389+0000", 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505542+0000", 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001153081 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505561+0000", 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9737000000000001e-05 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520723+0000", 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015161604 2024-09-12T21:51:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520760+0000", 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6992000000000001e-05 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34843 5.3 5:c19f014c:::benchmark_data_smithi053_32461_object34842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8118419199999991, 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015791453, 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34843 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769062+0000", 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8599999999999998e-07 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769180+0000", 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117528 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769188+0000", 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769193+0000", 2024-09-12T21:51:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2909999999999998e-06 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775815+0000", 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066217089999999999 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775962+0000", 2024-09-12T21:51:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146761 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.776105+0000", 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143688 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778491+0000", 2024-09-12T21:51:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023859549999999999 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784760+0000", 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062689449999999997 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784806+0000", 2024-09-12T21:51:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6283999999999999e-05 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784853+0000", 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6437999999999998e-05 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2411779000000003, 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2398563740000004, 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2393685310000002, 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2386411500000003, 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2328465929999997, 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47121 5.3 5:cbc49f71:::benchmark_data_smithi053_32461_object47120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.28096896, 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016851664999999998, 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47121 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299935+0000", 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299962+0000", 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7509999999999999e-05 2024-09-12T21:51:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299969+0000", 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8759999999999999e-06 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299974+0000", 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7820000000000001e-06 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304878+0000", 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049039740000000002 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305020+0000", 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014202999999999999 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305174+0000", 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153917 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.310026+0000", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00485192 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316699+0000", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00667331 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316746+0000", 2024-09-12T21:51:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6959000000000002e-05 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316786+0000", 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9920999999999999e-05 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47888 5.c 5:3f27c83c:::benchmark_data_smithi053_32461_object47887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9938185539999997, 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015402676000000001, 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47888 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587086+0000", 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587161+0000", 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5415999999999998e-05 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587171+0000", 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0182e-05 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587178+0000", 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8210000000000004e-06 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590776+0000", 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035977719999999999 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590868+0000", 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2153999999999999e-05 2024-09-12T21:51:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590964+0000", 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5733e-05 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.599419+0000", 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084549250000000003 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602400+0000", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029818650000000002 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602452+0000", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1445e-05 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602488+0000", 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5629000000000001e-05 2024-09-12T21:51:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:57356 5.c 5:3b320b6b:::benchmark_data_smithi053_32461_object57355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.2483006539999999, 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017334675000000001, 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57356 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332604+0000", 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1999999999999998e-07 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332683+0000", 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9876999999999994e-05 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332694+0000", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0163000000000001e-05 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332700+0000", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0780000000000001e-06 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335541+0000", 2024-09-12T21:51:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002841643 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335678+0000", 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013680800000000001 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335812+0000", 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133626 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341217+0000", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054050249999999999 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349884+0000", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086668939999999996 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349915+0000", 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1099999999999997e-05 2024-09-12T21:51:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349937+0000", 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2640999999999999e-05 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:57378 5.3 5:ca9c9d17:::benchmark_data_smithi053_32461_object57377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.2393090959999999, 2024-09-12T21:51:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01561719, 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57378 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341595+0000", 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341668+0000", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2747e-05 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341676+0000", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7129999999999994e-06 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341682+0000", 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0530000000000003e-06 2024-09-12T21:51:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341740+0000", 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7874000000000002e-05 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341824+0000", 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3793000000000002e-05 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341920+0000", 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5534999999999999e-05 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.348016+0000", 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060961799999999997 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357123+0000", 2024-09-12T21:51:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091068120000000006 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357175+0000", 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2633999999999998e-05 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357211+0000", 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6168999999999999e-05 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58027 5.5 5:a8429a67:::benchmark_data_smithi053_32461_object58026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.96353662500000004, 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01574536, 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58027 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7100000000000002e-07 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617447+0000", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9404000000000001e-05 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617453+0000", 2024-09-12T21:51:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4829999999999996e-06 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617457+0000", 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.568e-06 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619794+0000", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023377720000000001 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619900+0000", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105949 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619992+0000", 2024-09-12T21:51:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1793999999999996e-05 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.623228+0000", 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032356759999999998 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.632996+0000", 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097681980000000005 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.633068+0000", 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2000000000000002e-05 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.633112+0000", 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4045000000000003e-05 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58677 5.3 5:c6032fd2:::benchmark_data_smithi053_32461_object58676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.69724400200000003, 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019809620999999999, 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58677 2024-09-12T21:51:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883660+0000", 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.043e-06 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883749+0000", 2024-09-12T21:51:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8079999999999997e-05 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883766+0000", 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.738e-05 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883773+0000", 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7989999999999996e-06 2024-09-12T21:51:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890607+0000", 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006834148 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890711+0000", 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010463600000000001 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890844+0000", 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132278 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900952+0000", 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010108393 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903368+0000", 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024163069999999999 2024-09-12T21:51:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903426+0000", 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7590999999999998e-05 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903469+0000", 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:58676 5.b e31/21 5:dd2f110e:::benchmark_data_smithi053_32461_object58675:head v 31'3571, mlcod=31'3566)", 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.69637103199999995, 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016412498000000001, 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884533+0000", 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.99e-07 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884606+0000", 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3147999999999998e-05 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884617+0000", 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0531e-05 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884623+0000", 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5010000000000001e-06 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.887570+0000", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002946826 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.887589+0000", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8995999999999999e-05 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900846+0000", 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013257038000000001 2024-09-12T21:51:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900945+0000", 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8758999999999994e-05 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58693 5.3 5:ccf22776:::benchmark_data_smithi053_32461_object58692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.68770008000000005, 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015816969, 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58693 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893204+0000", 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893238+0000", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4560000000000001e-05 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893245+0000", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0169999999999999e-06 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893249+0000", 2024-09-12T21:51:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.968e-06 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.896826+0000", 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035763959999999999 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.896955+0000", 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012884600000000001 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.897091+0000", 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136756 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903354+0000", 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062621830000000002 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.908765+0000", 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054110879999999997 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.908979+0000", 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021425799999999999 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.909020+0000", 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1396000000000001e-05 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59382 5.a 5:54f36807:::benchmark_data_smithi053_32461_object59381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.39990545700000002, 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017002641999999998, 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59382 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180999+0000", 2024-09-12T21:51:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7100000000000011e-07 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181054+0000", 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4996e-05 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181065+0000", 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1100999999999999e-05 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181073+0000", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5469999999999999e-06 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189364+0000", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082915880000000008 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189516+0000", 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015163000000000001 2024-09-12T21:51:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189667+0000", 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015076099999999999 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.195978+0000", 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006311611 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.197896+0000", 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001917586 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.197946+0000", 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0176999999999997e-05 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.198001+0000", 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4673999999999999e-05 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60124 5.a 5:50f8165b:::benchmark_data_smithi053_32461_object60123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.087464941000000004, 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017303265000000002, 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60124 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493439+0000", 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4399999999999999e-07 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493499+0000", 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0105999999999997e-05 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493509+0000", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3850000000000008e-06 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493516+0000", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499636+0000", 2024-09-12T21:51:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061198559999999999 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499752+0000", 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011575500000000001 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499893+0000", 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014064200000000001 2024-09-12T21:51:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502090+0000", 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021975459999999999 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510660+0000", 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085698289999999993 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510704+0000", 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4379000000000003e-05 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510742+0000", 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7335000000000001e-05 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60125 5.a 5:5fb255f1:::benchmark_data_smithi053_32461_object60124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.087374521999999996, 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019623325, 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60125 2024-09-12T21:51:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493560+0000", 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0471e-05 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493571+0000", 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0888e-05 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493577+0000", 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2099999999999998e-06 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502136+0000", 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085587230000000007 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502271+0000", 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135611 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502428+0000", 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156229 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508707+0000", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062797859999999999 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513026+0000", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043189819999999999 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513087+0000", 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0899000000000001e-05 2024-09-12T21:51:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513152+0000", 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4937999999999994e-05 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60126 5.a 5:5d81c2ec:::benchmark_data_smithi053_32461_object60125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.087205151999999994, 2024-09-12T21:51:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019550358, 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60126 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493699+0000", 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493779+0000", 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9703999999999994e-05 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493787+0000", 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6500000000000002e-06 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493793+0000", 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8490000000000002e-06 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506164+0000", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012371105 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506324+0000", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015974500000000001 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506483+0000", 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158849 2024-09-12T21:51:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508749+0000", 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002265778 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513162+0000", 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044133480000000001 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513216+0000", 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3474999999999999e-05 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513249+0000", 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3064000000000001e-05 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60132 5.a 5:556f3c62:::benchmark_data_smithi053_32461_object60131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.084750922000000006, 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017158401, 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60132 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496153+0000", 2024-09-12T21:51:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496184+0000", 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0437e-05 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496193+0000", 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496199+0000", 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0850000000000002e-06 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508796+0000", 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01259682 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508917+0000", 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120677 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.509024+0000", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107394 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513012+0000", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003987656 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513269+0000", 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025691499999999998 2024-09-12T21:51:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513293+0000", 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4258000000000001e-05 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513311+0000", 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:18.717 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:18.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:18.719 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.718+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:18.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:18.819 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:18.818+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:18.849 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:18.861 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:18.862 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:18.869 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:18.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:18.887 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:18.887 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:18.920 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:18.920+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.015 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.015 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.021 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:19.020+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:19.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:19.122 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:19.121+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:19.211 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.211 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:19.224 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.223+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.325 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.324+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:2024-09-12T21:51:19.355891+0000 min lat: 0.00117781 max lat: 0.0697145 avg lat: 0.00514883 2024-09-12T21:51:19.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T21:51:19.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 20 16 62136 62120 194.108 146.5 0.00525018 0.00514883 2024-09-12T21:51:19.374 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.375 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:19.425 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.425+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.526 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.526+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.538 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.538 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:19.628 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.628+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.702 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.702 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:19.729 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:19.728+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:19.830 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.829+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:19.859 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:19.860 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:19.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:19.957 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:19.956+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:20.032 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.031+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:20.055 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.055 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:20.133 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.132+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:20.234 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:20.233+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:20.252 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.252 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:20.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:51:20.334 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:20.334+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:20.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 21 16 64506 64490 191.918 148.125 0.00306459 0.00520737 2024-09-12T21:51:20.412 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.412 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:20.435 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:20.435+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:20.536 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.535+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:20.668 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.667+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:20.737 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.736+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:20.767 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.767 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:20.838 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:20.837+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:20.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:20.913 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:20.913 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:20.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:20.939 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:20.938+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.031 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:21.039 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.038+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.050 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:21.068 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-09-12T21:51:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T21:51:21.108 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:21.108 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:21.108 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:21.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:21.165 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:21.164+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:21.241 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.240+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.242 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:51:21.254 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:34088 5.2 5:4e395165:::benchmark_data_smithi053_32461_object34087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:21.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.747319808, 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907631, 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34088 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:21.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503123+0000", 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1043999999999994e-05 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503134+0000", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0159999999999999e-05 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503140+0000", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503822+0000", 2024-09-12T21:51:21.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00068234899999999995 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503929+0000", 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107324 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.504049+0000", 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120228 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.506076+0000", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020266759999999998 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520873+0000", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01479723 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520928+0000", 2024-09-12T21:51:21.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4268999999999998e-05 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520969+0000", 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1650999999999998e-05 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:36611 5.f 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 11.878781870999999, 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017415061999999999, 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.263 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 36611 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371654+0000", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4367999999999999e-05 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371662+0000", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371667+0000", 2024-09-12T21:51:21.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-06 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374826+0000", 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031582749999999999 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374938+0000", 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111957 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.375059+0000", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121073 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.377750+0000", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026908750000000001 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388919+0000", 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011169231 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388974+0000", 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5612000000000002e-05 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.389015+0000", 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0145000000000003e-05 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9180261539999997, 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:21.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:21.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:21.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9177535859999999, 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:21.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9176956609999998, 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:21.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:21.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.288 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9166236919999999, 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:21.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:21.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:21.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9130751109999995, 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.295 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:21.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:21.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9117579570000007, 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:21.301 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:21.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:21.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9114038820000001, 2024-09-12T21:51:21.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:21.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9107960520000002, 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:21.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:21.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9107766099999992, 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:21.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:21.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.322 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9100701170000001, 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:21.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:21.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:55698 5.7 5:e85b9a0a:::benchmark_data_smithi053_32461_object55697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6065960170000002, 2024-09-12T21:51:21.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016727028000000001, 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 55698 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643786+0000", 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643874+0000", 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7808999999999999e-05 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643880+0000", 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2210000000000002e-06 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643884+0000", 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9779999999999999e-06 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647031+0000", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003147066 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647151+0000", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120487 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647298+0000", 2024-09-12T21:51:21.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014635599999999999 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.648722+0000", 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014237570000000001 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660426+0000", 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011704674 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660470+0000", 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4005000000000003e-05 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660512+0000", 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2227000000000001e-05 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.334 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:59376 5.2 5:430736e4:::benchmark_data_smithi053_32461_object59375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.0726059540000001, 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017754958000000001, 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 59376 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177776+0000", 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7299999999999995e-07 2024-09-12T21:51:21.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177840+0000", 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4253999999999998e-05 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177848+0000", 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9039999999999992e-06 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177854+0000", 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4e-06 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180161+0000", 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023070809999999999 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180291+0000", 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013008299999999999 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180451+0000", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016043599999999999 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.182642+0000", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021906009999999999 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195435+0000", 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012793574 2024-09-12T21:51:21.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195488+0000", 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2172000000000001e-05 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195530+0000", 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.278e-05 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:59377 5.2 5:48e09422:::benchmark_data_smithi053_32461_object59376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.0724982970000001, 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017802386999999999, 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 59377 2024-09-12T21:51:21.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177884+0000", 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1099999999999996e-07 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177908+0000", 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3972e-05 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177913+0000", 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2070000000000003e-06 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177917+0000", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2560000000000004e-06 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181385+0000", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034674279999999998 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181504+0000", 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011924100000000001 2024-09-12T21:51:21.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181630+0000", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012610400000000001 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.186253+0000", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046227869999999997 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195587+0000", 2024-09-12T21:51:21.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0093347919999999997 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195644+0000", 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6583999999999999e-05 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195686+0000", 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1505000000000003e-05 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:60866 5.1 5:8b4f3adf:::benchmark_data_smithi053_32461_object60865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.4426245180000001, 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020313339999999999, 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 60866 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807758+0000", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1200000000000002e-07 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807862+0000", 2024-09-12T21:51:21.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010445799999999999 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807868+0000", 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4299999999999997e-06 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807871+0000", 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7160000000000001e-06 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.816761+0000", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0088900679999999992 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.816883+0000", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012176900000000001 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.817039+0000", 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015590499999999999 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.821540+0000", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045014149999999999 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.827962+0000", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064216389999999998 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.828021+0000", 2024-09-12T21:51:21.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8576000000000003e-05 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.828070+0000", 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9651999999999998e-05 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:21.353 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.104356195, 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:21.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.359 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66255 5.9 5:99955d20:::benchmark_data_smithi053_32461_object66254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.099607950000000001, 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021555047000000001, 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66255 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150775+0000", 2024-09-12T21:51:21.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.424e-06 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150835+0000", 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000999999999997e-05 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150844+0000", 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1989999999999995e-06 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150849+0000", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150905+0000", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5303000000000002e-05 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150991+0000", 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6483000000000005e-05 2024-09-12T21:51:21.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.151075+0000", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3931000000000007e-05 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152865+0000", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001790402 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172225+0000", 2024-09-12T21:51:21.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019359483 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172282+0000", 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7494000000000002e-05 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172329+0000", 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6142e-05 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.365 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66257 5.9 5:98919938:::benchmark_data_smithi053_32461_object66256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.097509879999999993, 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020800945000000001, 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.366 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66257 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152873+0000", 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152927+0000", 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3758000000000003e-05 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152937+0000", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0796e-05 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152942+0000", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.023e-06 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152974+0000", 2024-09-12T21:51:21.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1466e-05 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153055+0000", 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1237999999999997e-05 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153140+0000", 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4484e-05 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.154659+0000", 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015191969999999999 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173591+0000", 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018932458999999999 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173629+0000", 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7985000000000003e-05 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173672+0000", 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3319999999999999e-05 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66341 5.f 5:fe6b921c:::benchmark_data_smithi053_32461_object66340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.047025315999999998, 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017229306, 2024-09-12T21:51:21.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66341 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203357+0000", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203440+0000", 2024-09-12T21:51:21.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2835000000000002e-05 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203452+0000", 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2334000000000001e-05 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203460+0000", 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3690000000000001e-06 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205267+0000", 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001806935 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205386+0000", 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119743 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205526+0000", 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013948300000000001 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.208610+0000", 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003083896 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220480+0000", 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011870623 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220530+0000", 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9373000000000003e-05 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220585+0000", 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5785000000000002e-05 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:21.378 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:21.381 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.379+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.382 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:51:21.383 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:21.383 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 22 16 66606 66590 189.159 131.25 0.00258366 0.00527449 2024-09-12T21:51:21.384 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-09-12T21:51:21.481 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:21.480+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:21.485 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5.7696ac38 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17513489199999999, 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.17515645299999999, 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5.a32a8c80 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16215726799999999, 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.16221850700000001, 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:21.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:21.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:21.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5.b85d2a84 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17507627200000001, 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.17517009, 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:21.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5.bc57318a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17296462600000001, 2024-09-12T21:51:21.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.17309063899999999, 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5.92c59168 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17130768399999999, 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.171464963, 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:21.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5.68033e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17035808499999999, 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.170546214, 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:21.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5.afa8251a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.166133998, 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.16635318099999999, 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:21.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5.5d962dde (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:21.515 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16378045999999999, 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.16403109799999999, 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:21.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5.fdc32e6e (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17526235100000001, 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.17554347200000001, 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:21.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:21.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:21.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-09-12T21:51:21.525 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:21.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:21.582 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.581+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.629 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:21.629 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:21.629 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:21.629 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:21.629 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:21.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:21.722 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.721+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:34088 5.2 e26/21 5:4e395165:::benchmark_data_smithi053_32461_object34087:head v 26'2154, mlcod=26'2151)", 2024-09-12T21:51:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.276746066999999, 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599526, 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504161+0000", 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.82e-07 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504378+0000", 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021676099999999999 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504384+0000", 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4529999999999999e-06 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.504389+0000", 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505542+0000", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001153081 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.505561+0000", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9737000000000001e-05 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520723+0000", 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015161604 2024-09-12T21:51:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.520760+0000", 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6992000000000001e-05 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:34843 5.3 5:c19f014c:::benchmark_data_smithi053_32461_object34842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.011845149999999, 2024-09-12T21:51:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015791453, 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34843 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769061+0000", 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769062+0000", 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8599999999999998e-07 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769180+0000", 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117528 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769188+0000", 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.769193+0000", 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2909999999999998e-06 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775815+0000", 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066217089999999999 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.775962+0000", 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146761 2024-09-12T21:51:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.776105+0000", 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143688 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.778491+0000", 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023859549999999999 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784760+0000", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062689449999999997 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784806+0000", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6283999999999999e-05 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:08.784853+0000", 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6437999999999998e-05 2024-09-12T21:51:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4411811300000004, 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4398596040000005, 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4393717610000003, 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4386443799999995, 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4328498229999997, 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47121 5.3 5:cbc49f71:::benchmark_data_smithi053_32461_object47120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4809721899999992, 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016851664999999998, 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47121 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299934+0000", 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299935+0000", 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299962+0000", 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7509999999999999e-05 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299969+0000", 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8759999999999999e-06 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.299974+0000", 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7820000000000001e-06 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.304878+0000", 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049039740000000002 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305020+0000", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014202999999999999 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.305174+0000", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153917 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.310026+0000", 2024-09-12T21:51:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00485192 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316699+0000", 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00667331 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316746+0000", 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6959000000000002e-05 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.316786+0000", 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9920999999999999e-05 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:47888 5.c 5:3f27c83c:::benchmark_data_smithi053_32461_object47887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1938217840000007, 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015402676000000001, 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47888 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587085+0000", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587086+0000", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587161+0000", 2024-09-12T21:51:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5415999999999998e-05 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587171+0000", 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0182e-05 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.587178+0000", 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8210000000000004e-06 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590776+0000", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035977719999999999 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590868+0000", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2153999999999999e-05 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.590964+0000", 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5733e-05 2024-09-12T21:51:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.599419+0000", 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084549250000000003 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602400+0000", 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029818650000000002 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602452+0000", 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1445e-05 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:13.602488+0000", 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5629000000000001e-05 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:57356 5.c 5:3b320b6b:::benchmark_data_smithi053_32461_object57355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4483038839999995, 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017334675000000001, 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57356 2024-09-12T21:51:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332603+0000", 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332604+0000", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1999999999999998e-07 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332683+0000", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9876999999999994e-05 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332694+0000", 2024-09-12T21:51:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0163000000000001e-05 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.332700+0000", 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0780000000000001e-06 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335541+0000", 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002841643 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335678+0000", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013680800000000001 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.335812+0000", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133626 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341217+0000", 2024-09-12T21:51:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054050249999999999 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349884+0000", 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086668939999999996 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349915+0000", 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1099999999999997e-05 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.349937+0000", 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2640999999999999e-05 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:57378 5.3 5:ca9c9d17:::benchmark_data_smithi053_32461_object57377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4393123259999996, 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01561719, 2024-09-12T21:51:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57378 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341594+0000", 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341595+0000", 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341668+0000", 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2747e-05 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341676+0000", 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7129999999999994e-06 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341682+0000", 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0530000000000003e-06 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341740+0000", 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7874000000000002e-05 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341824+0000", 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3793000000000002e-05 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.341920+0000", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5534999999999999e-05 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.348016+0000", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060961799999999997 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357123+0000", 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091068120000000006 2024-09-12T21:51:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357175+0000", 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2633999999999998e-05 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.357211+0000", 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6168999999999999e-05 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58027 5.5 5:a8429a67:::benchmark_data_smithi053_32461_object58026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1635398549999998, 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01574536, 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58027 2024-09-12T21:51:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617367+0000", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7100000000000002e-07 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617447+0000", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9404000000000001e-05 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617453+0000", 2024-09-12T21:51:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4829999999999996e-06 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.617457+0000", 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.568e-06 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619794+0000", 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023377720000000001 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619900+0000", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105949 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.619992+0000", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1793999999999996e-05 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.623228+0000", 2024-09-12T21:51:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032356759999999998 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.632996+0000", 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097681980000000005 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.633068+0000", 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2000000000000002e-05 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.633112+0000", 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4045000000000003e-05 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58677 5.3 5:c6032fd2:::benchmark_data_smithi053_32461_object58676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8972472319999998, 2024-09-12T21:51:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019809620999999999, 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58677 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883660+0000", 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.043e-06 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883749+0000", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8079999999999997e-05 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883766+0000", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.738e-05 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883773+0000", 2024-09-12T21:51:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7989999999999996e-06 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890607+0000", 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006834148 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890711+0000", 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010463600000000001 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890844+0000", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132278 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900952+0000", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010108393 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903368+0000", 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024163069999999999 2024-09-12T21:51:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903426+0000", 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7590999999999998e-05 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903469+0000", 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:58676 5.b e31/21 5:dd2f110e:::benchmark_data_smithi053_32461_object58675:head v 31'3571, mlcod=31'3566)", 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8963742620000001, 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016412498000000001, 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884532+0000", 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884533+0000", 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.99e-07 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884606+0000", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3147999999999998e-05 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884617+0000", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0531e-05 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.884623+0000", 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5010000000000001e-06 2024-09-12T21:51:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.887570+0000", 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002946826 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.887589+0000", 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8995999999999999e-05 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900846+0000", 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013257038000000001 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900945+0000", 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8758999999999994e-05 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58693 5.3 5:ccf22776:::benchmark_data_smithi053_32461_object58692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.88770331, 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015816969, 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58693 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893203+0000", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893204+0000", 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:51:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893238+0000", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4560000000000001e-05 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893245+0000", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0169999999999999e-06 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.893249+0000", 2024-09-12T21:51:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.968e-06 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.896826+0000", 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035763959999999999 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.896955+0000", 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012884600000000001 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.897091+0000", 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136756 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903354+0000", 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062621830000000002 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.908765+0000", 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054110879999999997 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.908979+0000", 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021425799999999999 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.909020+0000", 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1396000000000001e-05 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:59382 5.a 5:54f36807:::benchmark_data_smithi053_32461_object59381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5999086870000001, 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017002641999999998, 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 59382 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180998+0000", 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.180999+0000", 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7100000000000011e-07 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181054+0000", 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4996e-05 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181065+0000", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1100999999999999e-05 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.181073+0000", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5469999999999999e-06 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189364+0000", 2024-09-12T21:51:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082915880000000008 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189516+0000", 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015163000000000001 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.189667+0000", 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015076099999999999 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.195978+0000", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006311611 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.197896+0000", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001917586 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.197946+0000", 2024-09-12T21:51:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0176999999999997e-05 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.198001+0000", 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4673999999999999e-05 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60124 5.a 5:50f8165b:::benchmark_data_smithi053_32461_object60123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.287468171, 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017303265000000002, 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60124 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493438+0000", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493439+0000", 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4399999999999999e-07 2024-09-12T21:51:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493499+0000", 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0105999999999997e-05 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493509+0000", 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3850000000000008e-06 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493516+0000", 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499636+0000", 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061198559999999999 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499752+0000", 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011575500000000001 2024-09-12T21:51:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.499893+0000", 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014064200000000001 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502090+0000", 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021975459999999999 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510660+0000", 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085698289999999993 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510704+0000", 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4379000000000003e-05 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.510742+0000", 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7335000000000001e-05 2024-09-12T21:51:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60125 5.a 5:5fb255f1:::benchmark_data_smithi053_32461_object60124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.2873777519999998, 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019623325, 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60125 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493560+0000", 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0471e-05 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493571+0000", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0888e-05 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493577+0000", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2099999999999998e-06 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502136+0000", 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085587230000000007 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502271+0000", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135611 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502428+0000", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156229 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508707+0000", 2024-09-12T21:51:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062797859999999999 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513026+0000", 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043189819999999999 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513087+0000", 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0899000000000001e-05 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513152+0000", 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4937999999999994e-05 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60126 5.a 5:5d81c2ec:::benchmark_data_smithi053_32461_object60125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.2872083820000002, 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019550358, 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60126 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493698+0000", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493699+0000", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493779+0000", 2024-09-12T21:51:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9703999999999994e-05 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493787+0000", 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6500000000000002e-06 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493793+0000", 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8490000000000002e-06 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506164+0000", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012371105 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506324+0000", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015974500000000001 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.506483+0000", 2024-09-12T21:51:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158849 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508749+0000", 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002265778 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513162+0000", 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044133480000000001 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513216+0000", 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3474999999999999e-05 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513249+0000", 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3064000000000001e-05 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60132 5.a 5:556f3c62:::benchmark_data_smithi053_32461_object60131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.2847541520000001, 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017158401, 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60132 2024-09-12T21:51:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496152+0000", 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496153+0000", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496184+0000", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0437e-05 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496193+0000", 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.496199+0000", 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0850000000000002e-06 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508796+0000", 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01259682 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508917+0000", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120677 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.509024+0000", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107394 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513012+0000", 2024-09-12T21:51:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003987656 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513269+0000", 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025691499999999998 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513293+0000", 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4258000000000001e-05 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513311+0000", 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:21.910 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:21.912 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:21.910+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:21.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:22.012 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:22.011+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5.758b0abf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.69555315699999998, 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.69557250699999995, 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.018 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:22.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:22.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5.5d9e53f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.70754002299999996, 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.70760575000000003, 2024-09-12T21:51:22.022 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:22.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5.51f00749 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.68294334499999998, 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.68304273900000001, 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:22.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5.7a857be9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.70591862800000005, 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.70604971900000002, 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.031 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.035 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5.797f86c9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.70582859899999995, 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.70599162400000004, 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.036 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:22.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5.75925e8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.70265689799999997, 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.70285207000000005, 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:22.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5.6ca39c69 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.702136643, 2024-09-12T21:51:22.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.70236317100000001, 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:22.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:22.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 7 2024-09-12T21:51:22.049 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:22.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:22.113 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:22.112+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:22.192 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:22.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:22.193 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:22.193 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:22.193 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:22.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:22.245 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:22.244+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:34088 5.2 5:4e395165:::benchmark_data_smithi053_32461_object34087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.79954959, 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017907631, 2024-09-12T21:51:22.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 34088 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503062+0000", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503123+0000", 2024-09-12T21:51:22.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1043999999999994e-05 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503134+0000", 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0159999999999999e-05 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503140+0000", 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0059999999999998e-06 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503822+0000", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00068234899999999995 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.503929+0000", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107324 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.504049+0000", 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120228 2024-09-12T21:51:22.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.506076+0000", 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020266759999999998 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520873+0000", 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01479723 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520928+0000", 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4268999999999998e-05 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:08.520969+0000", 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1650999999999998e-05 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:36611 5.f 5:f6aae3e2:::benchmark_data_smithi053_32461_object36610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:22.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.931011653000001, 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017415061999999999, 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 36611 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371600+0000", 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371654+0000", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4367999999999999e-05 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371662+0000", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.371667+0000", 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-06 2024-09-12T21:51:22.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374826+0000", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031582749999999999 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.374938+0000", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111957 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.375059+0000", 2024-09-12T21:51:22.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121073 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.377750+0000", 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026908750000000001 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388919+0000", 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011169231 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.388974+0000", 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5612000000000002e-05 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:09.389015+0000", 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0145000000000003e-05 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.317 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9702559360000009, 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:22.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:22.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9699833679999994, 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.324 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:22.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:22.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9699254429999993, 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.330 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:22.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.335 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9688534739999994, 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:22.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:22.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9653048930000008, 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:22.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:22.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9639877390000002, 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.348 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:22.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:22.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9636336639999996, 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:22.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9630258339999997, 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:22.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9630063920000005, 2024-09-12T21:51:22.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:22.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.9622998989999996, 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:22.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:22.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:55698 5.7 5:e85b9a0a:::benchmark_data_smithi053_32461_object55697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.6588257989999997, 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016727028000000001, 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 55698 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643785+0000", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643786+0000", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643874+0000", 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7808999999999999e-05 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643880+0000", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2210000000000002e-06 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.643884+0000", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9779999999999999e-06 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647031+0000", 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003147066 2024-09-12T21:51:22.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647151+0000", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120487 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.647298+0000", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014635599999999999 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.648722+0000", 2024-09-12T21:51:22.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014237570000000001 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660426+0000", 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011704674 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660470+0000", 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4005000000000003e-05 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:16.660512+0000", 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2227000000000001e-05 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:59376 5.2 5:430736e4:::benchmark_data_smithi053_32461_object59375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.1248357359999996, 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017754958000000001, 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.377 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 59376 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177775+0000", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177776+0000", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7299999999999995e-07 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177840+0000", 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4253999999999998e-05 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177848+0000", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9039999999999992e-06 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177854+0000", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4e-06 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180161+0000", 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023070809999999999 2024-09-12T21:51:22.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180291+0000", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013008299999999999 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.180451+0000", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016043599999999999 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.182642+0000", 2024-09-12T21:51:22.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021906009999999999 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195435+0000", 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012793574 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195488+0000", 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2172000000000001e-05 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195530+0000", 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.278e-05 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:59377 5.2 5:48e09422:::benchmark_data_smithi053_32461_object59376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.1247280789999996, 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017802386999999999, 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 59377 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177883+0000", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177884+0000", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1099999999999996e-07 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177908+0000", 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3972e-05 2024-09-12T21:51:22.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177913+0000", 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2070000000000003e-06 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.177917+0000", 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2560000000000004e-06 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181385+0000", 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034674279999999998 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181504+0000", 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011924100000000001 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.181630+0000", 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012610400000000001 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.186253+0000", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046227869999999997 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195587+0000", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0093347919999999997 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195644+0000", 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6583999999999999e-05 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.195686+0000", 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1505000000000003e-05 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:60866 5.1 5:8b4f3adf:::benchmark_data_smithi053_32461_object60865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.4948543000000001, 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020313339999999999, 2024-09-12T21:51:22.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 60866 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807757+0000", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807758+0000", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1200000000000002e-07 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807862+0000", 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010445799999999999 2024-09-12T21:51:22.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807868+0000", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4299999999999997e-06 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.807871+0000", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7160000000000001e-06 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.816761+0000", 2024-09-12T21:51:22.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0088900679999999992 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.816883+0000", 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012176900000000001 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.817039+0000", 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015590499999999999 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.821540+0000", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045014149999999999 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.827962+0000", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0064216389999999998 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.828021+0000", 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8576000000000003e-05 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:18.828070+0000", 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9651999999999998e-05 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.156585977, 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66255 5.9 5:99955d20:::benchmark_data_smithi053_32461_object66254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.1518377319999999, 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021555047000000001, 2024-09-12T21:51:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66255 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150775+0000", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.424e-06 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150835+0000", 2024-09-12T21:51:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000999999999997e-05 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150844+0000", 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1989999999999995e-06 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150849+0000", 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150905+0000", 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5303000000000002e-05 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150991+0000", 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6483000000000005e-05 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.151075+0000", 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3931000000000007e-05 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152865+0000", 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001790402 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172225+0000", 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019359483 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172282+0000", 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7494000000000002e-05 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172329+0000", 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6142e-05 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66257 5.9 5:98919938:::benchmark_data_smithi053_32461_object66256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.149739662, 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020800945000000001, 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66257 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152873+0000", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152927+0000", 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3758000000000003e-05 2024-09-12T21:51:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152937+0000", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0796e-05 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152942+0000", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.023e-06 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152974+0000", 2024-09-12T21:51:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1466e-05 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153055+0000", 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1237999999999997e-05 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153140+0000", 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4484e-05 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.154659+0000", 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015191969999999999 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173591+0000", 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018932458999999999 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173629+0000", 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7985000000000003e-05 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173672+0000", 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3319999999999999e-05 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66341 5.f 5:fe6b921c:::benchmark_data_smithi053_32461_object66340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.099255098, 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.017229306, 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66341 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203356+0000", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203357+0000", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2999999999999999e-07 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203440+0000", 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2835000000000002e-05 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203452+0000", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2334000000000001e-05 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.203460+0000", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3690000000000001e-06 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205267+0000", 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001806935 2024-09-12T21:51:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205386+0000", 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119743 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.205526+0000", 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013948300000000001 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.208610+0000", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003083896 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220480+0000", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011870623 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220530+0000", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9373000000000003e-05 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.220585+0000", 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5785000000000002e-05 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:22.420 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:22.421 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 23 16 66703 66687 181.199 6.0625 0.0047818 0.00551591 2024-09-12T21:51:22.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:22.422 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:22.420+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:22.522 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:22.522+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:22.578 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:22.580 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:22.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:67224 5.7 e34/21 5:e61321ed:::benchmark_data_smithi053_32461_object67223:head v 34'4224, mlcod=34'4220)", 2024-09-12T21:51:22.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.576840+0000", 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00046801999999999998, 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048357000000000001, 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576840+0000", 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576840+0000", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576841+0000", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9900000000000001e-07 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576901+0000", 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0930000000000001e-05 2024-09-12T21:51:22.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576909+0000", 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576913+0000", 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0099999999999997e-06 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577084+0000", 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017140600000000001 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577096+0000", 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1677e-05 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:67228 5.2 e34/21 5:4a4482d5:::benchmark_data_smithi053_32461_object67227:head v 34'4109, mlcod=34'4106)", 2024-09-12T21:51:22.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.576935+0000", 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00037311899999999999, 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042416699999999998, 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576935+0000", 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576935+0000", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576935+0000", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-07 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577026+0000", 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1191000000000002e-05 2024-09-12T21:51:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577036+0000", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3179999999999996e-06 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577041+0000", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6829999999999996e-06 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577215+0000", 2024-09-12T21:51:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017394599999999999 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.577232+0000", 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6925000000000001e-05 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67221 5.5 5:a285893b:::benchmark_data_smithi053_32461_object67220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.572171+0000", 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0051371730000000001, 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052252710000000001, 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67221 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572171+0000", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572171+0000", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572172+0000", 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.61e-07 2024-09-12T21:51:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572201+0000", 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9060999999999998e-05 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572209+0000", 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7819999999999999e-06 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572215+0000", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7610000000000004e-06 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572254+0000", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9075000000000001e-05 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572410+0000", 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155845 2024-09-12T21:51:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572543+0000", 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013271800000000001 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576066+0000", 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035228630000000002 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67223 5.6 5:66d152c3:::benchmark_data_smithi053_32461_object67222:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.572323+0000", 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049852519999999999, 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051166179999999999, 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67223 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572323+0000", 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572323+0000", 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572324+0000", 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8500000000000001e-07 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572416+0000", 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2702999999999997e-05 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572425+0000", 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572432+0000", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6850000000000004e-06 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572497+0000", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5607999999999999e-05 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572606+0000", 2024-09-12T21:51:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109268 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.572732+0000", 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576043+0000", 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033108270000000001 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:67222 5.2 e34/21 5:433ce24d:::benchmark_data_smithi053_32461_object67221:head v 34'4108, mlcod=34'4106)", 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.573898+0000", 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003410359, 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035818769999999998, 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573898+0000", 2024-09-12T21:51:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573898+0000", 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573899+0000", 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.09e-07 2024-09-12T21:51:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573930+0000", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1000000000000001e-05 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573942+0000", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2680999999999999e-05 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.573958+0000", 2024-09-12T21:51:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5372000000000001e-05 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574011+0000", 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3609999999999997e-05 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574031+0000", 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9644e-05 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67227 5.4 5:2ef262b0:::benchmark_data_smithi053_32461_object67226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.574930+0000", 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023784959999999999, 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025811990000000002, 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67227 2024-09-12T21:51:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574930+0000", 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574930+0000", 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574930+0000", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2799999999999996e-07 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575034+0000", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103464 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575042+0000", 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8420000000000005e-06 2024-09-12T21:51:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575046+0000", 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0600000000000001e-06 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575088+0000", 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2438999999999998e-05 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575202+0000", 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113577 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:67220 5.7 e34/21 5:e8b989d8:::benchmark_data_smithi053_32461_object67219:head v 34'4223, mlcod=34'4220)", 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.574980+0000", 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023283589999999999, 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025636449999999998, 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574980+0000", 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574980+0000", 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.574980+0000", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575068+0000", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8270999999999996e-05 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575075+0000", 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3380000000000001e-06 2024-09-12T21:51:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575079+0000", 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3050000000000003e-06 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575114+0000", 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4495000000000001e-05 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.575125+0000", 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1718e-05 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67229 5.8 5:1013e370:::benchmark_data_smithi053_32461_object67228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.576369+0000", 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000938969, 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012077209999999999, 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67229 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576369+0000", 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576369+0000", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576370+0000", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7900000000000007e-07 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576509+0000", 2024-09-12T21:51:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013867600000000001 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576520+0000", 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0774000000000001e-05 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576526+0000", 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6939999999999998e-06 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576571+0000", 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4671e-05 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.576654+0000", 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2987999999999999e-05 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 8 2024-09-12T21:51:22.615 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:22.617 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:22.623 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:22.622+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:22.723 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:22.722+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:22.769 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:22.769 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:22.769 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:22.769 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:22.769 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:22.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:22.825 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:22.824+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:22.926 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:22.925+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.632777576000001, 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.631456050000001, 2024-09-12T21:51:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.630968207, 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.630240826, 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.624446269, 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:58677 5.3 5:c6032fd2:::benchmark_data_smithi053_32461_object58676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0888436779999999, 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019809620999999999, 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58677 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883659+0000", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883660+0000", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.043e-06 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883749+0000", 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8079999999999997e-05 2024-09-12T21:51:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883766+0000", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.738e-05 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.883773+0000", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7989999999999996e-06 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890607+0000", 2024-09-12T21:51:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006834148 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890711+0000", 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010463600000000001 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.890844+0000", 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132278 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.900952+0000", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010108393 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903368+0000", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024163069999999999 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903426+0000", 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7590999999999998e-05 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:17.903469+0000", 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:60125 5.a 5:5fb255f1:::benchmark_data_smithi053_32461_object60124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4789741980000004, 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019623325, 2024-09-12T21:51:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 60125 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493529+0000", 2024-09-12T21:51:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493560+0000", 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0471e-05 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493571+0000", 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0888e-05 2024-09-12T21:51:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.493577+0000", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2099999999999998e-06 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502136+0000", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085587230000000007 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502271+0000", 2024-09-12T21:51:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135611 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.502428+0000", 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156229 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.508707+0000", 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062797859999999999 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513026+0000", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043189819999999999 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513087+0000", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0899000000000001e-05 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:18.513152+0000", 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4937999999999994e-05 2024-09-12T21:51:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.663396775, 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6632693160000001, 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6632106960000002, 2024-09-12T21:51:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.66109905, 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6594421079999999, 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.658492509, 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6542684219999999, 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.651914884, 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6502916920000001, 2024-09-12T21:51:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67461 5.c 5:3916cbf1:::benchmark_data_smithi053_32461_object67460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.29960297000000002, 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020671854, 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67461 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672901+0000", 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672930+0000", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9240000000000001e-05 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672939+0000", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1959999999999997e-06 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672948+0000", 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677447+0000", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044995670000000003 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677520+0000", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2238999999999997e-05 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677604+0000", 2024-09-12T21:51:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4213000000000002e-05 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680967+0000", 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033630029999999998 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693440+0000", 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012473451 2024-09-12T21:51:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693492+0000", 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1924e-05 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693572+0000", 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9721999999999993e-05 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67464 5.4 5:25f32e5f:::benchmark_data_smithi053_32461_object67463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674013+0000", 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.298489754, 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019712158, 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67464 2024-09-12T21:51:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674013+0000", 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674013+0000", 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674014+0000", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000002e-07 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674039+0000", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4882e-05 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674046+0000", 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1389999999999998e-06 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674052+0000", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7649999999999999e-06 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.679008+0000", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049559929999999997 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.679091+0000", 2024-09-12T21:51:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2967999999999996e-05 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693595+0000", 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014504576 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693635+0000", 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9993999999999997e-05 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693725+0000", 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0246000000000003e-05 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.29780161700000002, 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67469 5.4 5:269ecf1a:::benchmark_data_smithi053_32461_object67468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.29637350299999998, 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020489384999999999, 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67469 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676131+0000", 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.192e-06 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676226+0000", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5731999999999998e-05 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676237+0000", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0903e-05 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676245+0000", 2024-09-12T21:51:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3320000000000003e-06 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684707+0000", 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084621990000000001 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684887+0000", 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018032500000000001 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696492+0000", 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011605153 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696542+0000", 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9458e-05 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696619+0000", 2024-09-12T21:51:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7090999999999998e-05 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:23.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:23.106 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:23.104+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:23.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:23.206 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:23.206+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:23.242 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.254 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:23.254 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:23.254 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:23.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:23.257 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:23.258 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:23.310 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:23.307+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:23.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 24 16 69056 69040 179.775 147.062 0.00260696 0.00555207 2024-09-12T21:51:23.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:51:23.402 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.403 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.410 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:23.408+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:23.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:23.510 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:23.509+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:23.516 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.516 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:23.611 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:23.610+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:23.628 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.628 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:23.712 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:23.711+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:23.744 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.745 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:23.812 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:23.812+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:23.905 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:23.905 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:23.913 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:23.912+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:23.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:24.014 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:24.014+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:24.018 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.019 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:24.115 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.113+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.129 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:24.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T21:51:24.221 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.220+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.280 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.280 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:24.332 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.329+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 25 16 69056 69040 172.584 0 - 0.00555207 2024-09-12T21:51:24.393 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.394 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:51:24.418 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.416+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.519 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:24.518+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:24.539 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.539 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:24.620 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.618+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.721 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:24.720+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:24.749 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.749 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:24.822 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:24.820+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:24.911 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:24.911 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:24.922 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:24.922+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:24.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:25.023 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:25.022+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:25.106 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:25.106 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:25.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:25.124 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:25.123+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:25.225 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:25.224+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:25.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:25.259 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:25.260 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:25.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:25.326 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:25.324+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:25.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 26 16 71212 71196 171.129 67.375 0.00583039 0.00584107 2024-09-12T21:51:25.384 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:51:25.394 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:25.394 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:25.409 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:25.409 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:25.409 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:25.413 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:25.414 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71358 5.c 5:3ede069e:::benchmark_data_smithi053_32461_object71357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.421258+0000", 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036047039999999998, 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003630154, 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71358 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421258+0000", 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421258+0000", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421259+0000", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-07 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421296+0000", 2024-09-12T21:51:25.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7512999999999998e-05 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421306+0000", 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8060000000000006e-06 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421312+0000", 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2550000000000003e-06 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421364+0000", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1177000000000001e-05 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421485+0000", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012101500000000001 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421621+0000", 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136286 2024-09-12T21:51:25.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423844+0000", 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022232760000000002 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71359 5.b 5:de65877e:::benchmark_data_smithi053_32461_object71358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.421851+0000", 2024-09-12T21:51:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003012163, 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117159, 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71359 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421851+0000", 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421851+0000", 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421852+0000", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.78e-07 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421981+0000", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012971599999999999 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421992+0000", 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1144999999999999e-05 2024-09-12T21:51:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421999+0000", 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0280000000000003e-06 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423406+0000", 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014066860000000001 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423494+0000", 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7645000000000005e-05 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71361 5.b 5.a5293f8b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.422281+0000", 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002581262, 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027440070000000001, 2024-09-12T21:51:25.437 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71361 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422281+0000", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422281+0000", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422282+0000", 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4e-07 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422357+0000", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4634000000000004e-05 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422367+0000", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0141e-05 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.422373+0000", 2024-09-12T21:51:25.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0689999999999998e-06 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71362 5.2 5:4a7fa21d:::benchmark_data_smithi053_32461_object71361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.423608+0000", 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012549729999999999, 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014698420000000001, 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71362 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423608+0000", 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423608+0000", 2024-09-12T21:51:25.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423609+0000", 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.142e-06 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423661+0000", 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423673+0000", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2014999999999999e-05 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423682+0000", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423730+0000", 2024-09-12T21:51:25.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8677999999999997e-05 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423876+0000", 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014589400000000001 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423975+0000", 2024-09-12T21:51:25.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9161999999999997e-05 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71363 5.8 5:124680aa:::benchmark_data_smithi053_32461_object71362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.423811+0000", 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010515959999999999, 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013343879999999999, 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71363 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423811+0000", 2024-09-12T21:51:25.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423811+0000", 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423812+0000", 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8999999999999995e-07 2024-09-12T21:51:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423877+0000", 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4728999999999996e-05 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423888+0000", 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1326e-05 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423896+0000", 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423943+0000", 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6761999999999997e-05 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.424053+0000", 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010999 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71364 5.5 5:a7264192:::benchmark_data_smithi053_32461_object71363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.423913+0000", 2024-09-12T21:51:25.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00094968899999999998, 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012931539999999999, 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71364 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423913+0000", 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423913+0000", 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423914+0000", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9200000000000001e-07 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423943+0000", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9169000000000001e-05 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423958+0000", 2024-09-12T21:51:25.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4718999999999999e-05 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.423963+0000", 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9669999999999998e-06 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.424021+0000", 2024-09-12T21:51:25.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7132999999999997e-05 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.424154+0000", 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013359299999999999 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.424307+0000", 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015327200000000001 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71344 5.2 5:412e7392:::benchmark_data_smithi053_32461_object71343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.416124+0000", 2024-09-12T21:51:25.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0087390009999999997, 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091571110000000008, 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71344 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416124+0000", 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416124+0000", 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416125+0000", 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.066e-06 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416263+0000", 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013830400000000001 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416272+0000", 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2690000000000005e-06 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416280+0000", 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.204e-06 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416329+0000", 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8974999999999998e-05 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416442+0000", 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113193 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416590+0000", 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148596 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.420720+0000", 2024-09-12T21:51:25.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041293440000000001 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71346 5.2 5:4f62a2ba:::benchmark_data_smithi053_32461_object71345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.416434+0000", 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084286650000000001, 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089265679999999993, 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71346 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416434+0000", 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416434+0000", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416435+0000", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.54e-07 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416462+0000", 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7628999999999999e-05 2024-09-12T21:51:25.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416471+0000", 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.225e-06 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416482+0000", 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.169e-05 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418390+0000", 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001907604 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418508+0000", 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011851 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418656+0000", 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014747800000000001 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71350 5.a 5:5211589a:::benchmark_data_smithi053_32461_object71349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.416998+0000", 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078651490000000001, 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084361999999999996, 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71350 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416998+0000", 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416998+0000", 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.416998+0000", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-07 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.417026+0000", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7951000000000001e-05 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.417033+0000", 2024-09-12T21:51:25.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1199999999999996e-06 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.417038+0000", 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418418+0000", 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013791400000000001 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418527+0000", 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108906 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.418677+0000", 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150827 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71351 5.3 5:c18ff06e:::benchmark_data_smithi053_32461_object71350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.419050+0000", 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058131229999999999, 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064601809999999997, 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71351 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419050+0000", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419050+0000", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419051+0000", 2024-09-12T21:51:25.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2529999999999999e-06 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419084+0000", 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2953000000000001e-05 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419095+0000", 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1283e-05 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419103+0000", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7470000000000005e-06 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419299+0000", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019594 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419378+0000", 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9344000000000005e-05 2024-09-12T21:51:25.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419459+0000", 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1054e-05 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.425497+0000", 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060381790000000003 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71352 5.a 5:5376a11d:::benchmark_data_smithi053_32461_object71351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.419123+0000", 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057402149999999999, 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064316629999999998, 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71352 2024-09-12T21:51:25.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419123+0000", 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419123+0000", 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419123+0000", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0900000000000001e-07 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419152+0000", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8807e-05 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419160+0000", 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8930000000000005e-06 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419165+0000", 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5589999999999996e-06 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.420739+0000", 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001573851 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.420846+0000", 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010662099999999999 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.420939+0000", 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3148999999999999e-05 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71353 5.b 5:d374ef18:::benchmark_data_smithi053_32461_object71352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.419176+0000", 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056869340000000003, 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064176629999999997, 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71353 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419176+0000", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419176+0000", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419176+0000", 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:25.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419203+0000", 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6258000000000002e-05 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419211+0000", 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8509999999999999e-06 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419216+0000", 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4260000000000002e-06 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421014+0000", 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001797582 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421126+0000", 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112108 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71355 5.3 5:c30a3c85:::benchmark_data_smithi053_32461_object71354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.419536+0000", 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053264949999999997, 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006093233, 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71355 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419536+0000", 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419536+0000", 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419537+0000", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0400000000000005e-07 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419609+0000", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1605000000000003e-05 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419636+0000", 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7072000000000001e-05 2024-09-12T21:51:25.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.419642+0000", 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0750000000000003e-06 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421164+0000", 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015217690000000001 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421273+0000", 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108875 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.421395+0000", 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252500000000001 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-09-12T21:51:25.493 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:25.495 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:25.425+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:25.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:25.496 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-09-12T21:51:25.527 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:25.526+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:25.629 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:25.627+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:25.654 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:25.655 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:25.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:25.729 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:25.727+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:25.830 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:25.829+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:25.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.523764027, 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:25.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:25.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.522442501, 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:25.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:25.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:25.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.521954658, 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:25.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:25.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:25.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.521227276999999, 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:25.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:25.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.51543272, 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:25.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:25.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5543832259999997, 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:25.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5542557669999999, 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:25.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:25.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.554197147, 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:25.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:25.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5520855009999996, 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:25.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:25.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:25.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5504285590000002, 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:25.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5494789600000001, 2024-09-12T21:51:25.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:25.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:25.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5452548730000002, 2024-09-12T21:51:25.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:25.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5429013349999998, 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:25.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:25.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5412781429999995, 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:25.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67461 5.c 5:3916cbf1:::benchmark_data_smithi053_32461_object67460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:25.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.1905894209999999, 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020671854, 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67461 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672901+0000", 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:25.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672930+0000", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9240000000000001e-05 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672939+0000", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1959999999999997e-06 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672948+0000", 2024-09-12T21:51:25.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677447+0000", 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044995670000000003 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677520+0000", 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2238999999999997e-05 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677604+0000", 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4213000000000002e-05 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680967+0000", 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033630029999999998 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693440+0000", 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012473451 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693492+0000", 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1924e-05 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693572+0000", 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9721999999999993e-05 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.188788068, 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:25.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:25.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67469 5.4 5:269ecf1a:::benchmark_data_smithi053_32461_object67468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.1873599540000002, 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020489384999999999, 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67469 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676131+0000", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.192e-06 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676226+0000", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5731999999999998e-05 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676237+0000", 2024-09-12T21:51:25.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0903e-05 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676245+0000", 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3320000000000003e-06 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684707+0000", 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084621990000000001 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684887+0000", 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018032500000000001 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696492+0000", 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011605153 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696542+0000", 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9458e-05 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696619+0000", 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7090999999999998e-05 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71699 5.a 5:5ab4becd:::benchmark_data_smithi053_32461_object71698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.29398657099999997, 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020503668999999999, 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71699 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569504+0000", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569587+0000", 2024-09-12T21:51:25.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3487999999999998e-05 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569596+0000", 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8009999999999993e-06 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569601+0000", 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4060000000000004e-06 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577278+0000", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076762289999999997 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577398+0000", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012074399999999999 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577549+0000", 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151056 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.587509+0000", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099601110000000007 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589866+0000", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023569530000000002 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589918+0000", 2024-09-12T21:51:25.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1187000000000003e-05 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590007+0000", 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.899e-05 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71700 5.2 5:49d9f99f:::benchmark_data_smithi053_32461_object71699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:25.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.293854538, 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020461822000000001, 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71700 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:25.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569636+0000", 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5700000000000001e-07 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569711+0000", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5587000000000007e-05 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569719+0000", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3189999999999997e-06 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569724+0000", 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-06 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580669+0000", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010944980999999999 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580782+0000", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113007 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580921+0000", 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013887700000000001 2024-09-12T21:51:25.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589894+0000", 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089733039999999997 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590016+0000", 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012229299999999999 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590047+0000", 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590097+0000", 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0272999999999998e-05 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:72043 5.2 5:460d4ddb:::benchmark_data_smithi053_32461_object72042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:25.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.14351956199999999, 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020754093000000001, 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72043 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:25.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719971+0000", 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720029+0000", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8554000000000002e-05 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720042+0000", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2889e-05 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720049+0000", 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:51:25.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729266+0000", 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092164710000000004 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729387+0000", 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:25.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729557+0000", 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016992600000000001 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.738496+0000", 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089387670000000002 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740587+0000", 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020911359999999999 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740639+0000", 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740724+0000", 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5148000000000005e-05 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:25.988 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:25.990 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:25.988+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:25.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:26.091 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:26.089+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:26.140 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:73004 5.d 5:bf5a8dab:::benchmark_data_smithi053_32461_object73003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:26.134558+0000", 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0051345009999999996, 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051604989999999998, 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 73004 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134558+0000", 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134558+0000", 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134559+0000", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6099999999999999e-07 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134618+0000", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9209000000000002e-05 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134640+0000", 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1437000000000002e-05 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134648+0000", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0320000000000003e-06 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136244+0000", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015960639999999999 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136381+0000", 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013782099999999999 2024-09-12T21:51:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:73006 5.6 5:69b79e91:::benchmark_data_smithi053_32461_object73005:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:26.134883+0000", 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0048092259999999998, 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049146379999999998, 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 73006 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134883+0000", 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134883+0000", 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134884+0000", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134950+0000", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6266000000000006e-05 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134962+0000", 2024-09-12T21:51:26.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1304999999999999e-05 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.134969+0000", 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.413e-06 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135016+0000", 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6365000000000001e-05 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135103+0000", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7337999999999996e-05 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135209+0000", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000105908 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137267+0000", 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002058392 2024-09-12T21:51:26.149 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:73008 5.9 5:9ad504f7:::benchmark_data_smithi053_32461_object73007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:26.135842+0000", 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0038501709999999999, 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040239660000000003, 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.150 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 73008 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135842+0000", 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135842+0000", 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135843+0000", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2900000000000002e-07 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135896+0000", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2478999999999997e-05 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135904+0000", 2024-09-12T21:51:26.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4409999999999993e-06 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135910+0000", 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7880000000000003e-06 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.135954+0000", 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4183e-05 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136072+0000", 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118468 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.139844+0000", 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037711680000000001 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:73009 5.9 5:9701f8ba:::benchmark_data_smithi053_32461_object73008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:26.136342+0000", 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.003350319, 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035647809999999999, 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 73009 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136342+0000", 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136342+0000", 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136343+0000", 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6700000000000002e-07 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136433+0000", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0457999999999993e-05 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136443+0000", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7939999999999997e-06 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.136450+0000", 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5799999999999997e-06 2024-09-12T21:51:26.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.138116+0000", 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001666472 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.138215+0000", 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9176e-05 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:73013 5.d 5:bb18fd28:::benchmark_data_smithi053_32461_object73012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:26.137341+0000", 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023515350000000001, 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026115190000000001, 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 73013 2024-09-12T21:51:26.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137341+0000", 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137341+0000", 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137342+0000", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5300000000000004e-07 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137386+0000", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4360000000000002e-05 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137393+0000", 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1770000000000001e-06 2024-09-12T21:51:26.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.137398+0000", 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4719999999999997e-06 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.138533+0000", 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011354970000000001 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:26.138676+0000", 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000143084 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 5 2024-09-12T21:51:26.163 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:26.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:26.191 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:26.190+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:26.293 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:26.291+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:26.350 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:26.350 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:26.350 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:26.350 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:26.350 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:26.356 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 27 16 73544 73528 170.188 145.75 0.00734052 0.00587321 2024-09-12T21:51:26.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:26.394 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:26.393+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:26.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:51:26.495 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:26.493+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.214572787, 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.214300219, 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.214242294, 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.213170325, 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.209621744, 2024-09-12T21:51:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.208304590000001, 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.207950515, 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.207342685, 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.207323242999999, 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 14.20661675, 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.4009028279999995, 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66255 5.9 5:99955d20:::benchmark_data_smithi053_32461_object66254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3961545830000004, 2024-09-12T21:51:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021555047000000001, 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66255 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150775+0000", 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.424e-06 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150835+0000", 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000999999999997e-05 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150844+0000", 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1989999999999995e-06 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150849+0000", 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150905+0000", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5303000000000002e-05 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150991+0000", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6483000000000005e-05 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.151075+0000", 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3931000000000007e-05 2024-09-12T21:51:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152865+0000", 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001790402 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172225+0000", 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019359483 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172282+0000", 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7494000000000002e-05 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172329+0000", 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6142e-05 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66257 5.9 5:98919938:::benchmark_data_smithi053_32461_object66256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.3940565129999998, 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020800945000000001, 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66257 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152873+0000", 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152927+0000", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3758000000000003e-05 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152937+0000", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0796e-05 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152942+0000", 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.023e-06 2024-09-12T21:51:26.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152974+0000", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1466e-05 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153055+0000", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1237999999999997e-05 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153140+0000", 2024-09-12T21:51:26.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4484e-05 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.154659+0000", 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015191969999999999 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173591+0000", 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018932458999999999 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173629+0000", 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7985000000000003e-05 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173672+0000", 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3319999999999999e-05 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.624 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.237096652, 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.625 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:26.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:26.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:26.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.630 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.235475257, 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:26.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:26.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2353852280000002, 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:26.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:26.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2322135269999999, 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:26.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:26.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.649 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.2316932720000002, 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:26.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.225109786, 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.656 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:26.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.212499974, 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:26.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:26.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:26.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:26.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:26.668 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:26.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:26.670 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:26.667+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:26.770 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:26.769+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:26.828 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74643 5.a 5:5bbe75a1:::benchmark_data_smithi053_32461_object74642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.820189+0000", 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059339700000000002, 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059630029999999997, 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74643 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820189+0000", 2024-09-12T21:51:26.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820189+0000", 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820190+0000", 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4200000000000004e-07 2024-09-12T21:51:26.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820219+0000", 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9090000000000001e-05 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820246+0000", 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6710999999999999e-05 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.820253+0000", 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2529999999999998e-06 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822686+0000", 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024331119999999999 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822799+0000", 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112667 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822955+0000", 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015655000000000001 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74645 5.2 5:4e3052f5:::benchmark_data_smithi053_32461_object74644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.822242+0000", 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038811520000000001, 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039859409999999998, 2024-09-12T21:51:26.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74645 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822242+0000", 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822242+0000", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822243+0000", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0020000000000001e-06 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822345+0000", 2024-09-12T21:51:26.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102654 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822354+0000", 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9390000000000003e-06 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822361+0000", 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822681+0000", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032001399999999998 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822824+0000", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014336899999999999 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822980+0000", 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015579 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74646 5.a 5:5635b8c6:::benchmark_data_smithi053_32461_object74645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.822912+0000", 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032103240000000001, 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033854699999999998, 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74646 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822912+0000", 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822912+0000", 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822913+0000", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822940+0000", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7104999999999999e-05 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822948+0000", 2024-09-12T21:51:26.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5170000000000002e-06 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822954+0000", 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.63e-06 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824700+0000", 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001745894 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824861+0000", 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160648 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825050+0000", 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018889500000000001 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74648 5.0 5:066240a2:::benchmark_data_smithi053_32461_object74647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.822969+0000", 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031540280000000001, 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033973649999999998, 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74648 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822969+0000", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822969+0000", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.822969+0000", 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4199999999999995e-07 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823099+0000", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012952499999999999 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823107+0000", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859999999999999e-06 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823114+0000", 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2689999999999996e-06 2024-09-12T21:51:26.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823180+0000", 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5969999999999993e-05 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823309+0000", 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012963800000000001 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74649 5.8 5:15340923:::benchmark_data_smithi053_32461_object74648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.823129+0000", 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002993365, 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032980990000000001, 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74649 2024-09-12T21:51:26.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823129+0000", 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823129+0000", 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823130+0000", 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000004e-07 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823465+0000", 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033474600000000002 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823473+0000", 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1489999999999994e-06 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823479+0000", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5359999999999998e-06 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823524+0000", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4855999999999999e-05 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823658+0000", 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013357399999999999 2024-09-12T21:51:26.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74651 5.4 5:2aed7df3:::benchmark_data_smithi053_32461_object74650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.823592+0000", 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025302940000000002, 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028951300000000001, 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74651 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823592+0000", 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823592+0000", 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823593+0000", 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4099999999999998e-07 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823625+0000", 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2011999999999998e-05 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823634+0000", 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4090000000000003e-06 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823641+0000", 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823688+0000", 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6998e-05 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.823797+0000", 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109558 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74652 5.a 5.60b9f2fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.824449+0000", 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001673934, 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020944959999999999, 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74652 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824449+0000", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824449+0000", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824450+0000", 2024-09-12T21:51:26.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8299999999999996e-07 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824483+0000", 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3188999999999997e-05 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824496+0000", 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3400999999999999e-05 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824507+0000", 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0949e-05 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPushReply(5.a 37/36 [PushReplyOp(5:515ecde6:::benchmark_data_smithi053_32461_object70724:head)])", 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.824912+0000", 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012108939999999999, 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016803880000000001, 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824912+0000", 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824912+0000", 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824913+0000", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7700000000000004e-07 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824923+0000", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.004e-05 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824932+0000", 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824939+0000", 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74655 5.0 5.56182280 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.824980+0000", 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011428040000000001, 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016534659999999999, 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74655 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824980+0000", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824980+0000", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.824981+0000", 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6000000000000003e-07 2024-09-12T21:51:26.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825008+0000", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.762e-05 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825017+0000", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.568e-06 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825025+0000", 2024-09-12T21:51:26.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1040000000000007e-06 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74656 5.3 5:c33309cf:::benchmark_data_smithi053_32461_object74655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825036+0000", 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010864410000000001, 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001648753, 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74656 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825036+0000", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825036+0000", 2024-09-12T21:51:26.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825037+0000", 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4099999999999999e-07 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825072+0000", 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172999999999997e-05 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825088+0000", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6144999999999999e-05 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825094+0000", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779999999999999e-06 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825147+0000", 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2550999999999999e-05 2024-09-12T21:51:26.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825260+0000", 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112792 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825392+0000", 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013227900000000001 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74657 5.5 5:a41dbd8e:::benchmark_data_smithi053_32461_object74656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825110+0000", 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010129850000000001, 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001641216, 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74657 2024-09-12T21:51:26.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825110+0000", 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825110+0000", 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825110+0000", 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999996e-07 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825144+0000", 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3451999999999998e-05 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825153+0000", 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6980000000000004e-06 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825158+0000", 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.947e-06 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825200+0000", 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1176e-05 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825301+0000", 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101091 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825421+0000", 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012055100000000001 2024-09-12T21:51:26.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74659 5.c 5:31bad0df:::benchmark_data_smithi053_32461_object74658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825171+0000", 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00095137599999999998, 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016449329999999999, 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74659 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825171+0000", 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825171+0000", 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825172+0000", 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6300000000000005e-07 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825199+0000", 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6905000000000001e-05 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825206+0000", 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825212+0000", 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6999999999999996e-06 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825399+0000", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744000000000001 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825513+0000", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011385 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825633+0000", 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119801 2024-09-12T21:51:26.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:74653 5.7 e37/21 5:e0526775:::benchmark_data_smithi053_32461_object74652:head v 37'4661, mlcod=37'4659)", 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825242+0000", 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00088115000000000003, 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001643608, 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825242+0000", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825242+0000", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825242+0000", 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.96e-07 2024-09-12T21:51:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825268+0000", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6412000000000001e-05 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825275+0000", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7909999999999999e-06 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825280+0000", 2024-09-12T21:51:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5789999999999997e-06 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825331+0000", 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0800999999999997e-05 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825352+0000", 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1851000000000001e-05 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:74643 5.a e37/36)", 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825291+0000", 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00083135800000000003, 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001642377, 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825291+0000", 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825291+0000", 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825292+0000", 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1199999999999999e-07 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825294+0000", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.007e-06 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825300+0000", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2670000000000003e-06 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825304+0000", 2024-09-12T21:51:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2660000000000003e-06 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:74654 5.6 e37/36 5:675a9998:::benchmark_data_smithi053_32461_object74653:head v 37'4709, mlcod=37'4707)", 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825578+0000", 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00054495800000000001, 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014024020000000001, 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825578+0000", 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825578+0000", 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825578+0000", 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2600000000000002e-07 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825606+0000", 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8016000000000001e-05 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825615+0000", 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3089999999999996e-06 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825621+0000", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9000000000000003e-06 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825780+0000", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015971799999999999 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825800+0000", 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9896999999999999e-05 2024-09-12T21:51:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:74661 5.2 5.8c7d802 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.825733+0000", 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00039011500000000001, 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001298848, 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74661 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825733+0000", 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825733+0000", 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.825733+0000", 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7000000000000004e-07 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826237+0000", 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00050330999999999998 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826250+0000", 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3038e-05 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826257+0000", 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8560000000000001e-06 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:74645 5.2 e37/36)", 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:26.826728+0000", 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9993949, 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000353192, 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826728+0000", 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826728+0000", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826728+0000", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826732+0000", 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4429999999999999e-06 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826740+0000", 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2530000000000004e-06 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:26.826746+0000", 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 17 2024-09-12T21:51:26.900 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:26.901 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:26.902 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:26.899+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:27.002 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:27.000+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:27.095 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:27.095 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:27.095 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:27.095 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:27.095 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:27.102 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:27.101+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:27.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:27.204 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:27.203+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.918196711, 2024-09-12T21:51:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.916875185, 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.916387342, 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.915659960999999, 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.909865404, 2024-09-12T21:51:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9488159100000004, 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9486884509999998, 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9486298309999999, 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9465181850000004, 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9448612430000001, 2024-09-12T21:51:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9439116439999999, 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:27.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:27.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9396875570000001, 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:27.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:27.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:27.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9373340189999997, 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:27.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:27.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:27.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9357108270000003, 2024-09-12T21:51:27.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:27.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:27.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67461 5.c 5:3916cbf1:::benchmark_data_smithi053_32461_object67460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5850221050000002, 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020671854, 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67461 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672901+0000", 2024-09-12T21:51:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672930+0000", 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9240000000000001e-05 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672939+0000", 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1959999999999997e-06 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672948+0000", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677447+0000", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044995670000000003 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677520+0000", 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2238999999999997e-05 2024-09-12T21:51:27.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677604+0000", 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4213000000000002e-05 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680967+0000", 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033630029999999998 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693440+0000", 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012473451 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693492+0000", 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1924e-05 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693572+0000", 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9721999999999993e-05 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.354 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5832207519999999, 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:27.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67469 5.4 5:269ecf1a:::benchmark_data_smithi053_32461_object67468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5817926379999996, 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020489384999999999, 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67469 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676130+0000", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676131+0000", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.192e-06 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676226+0000", 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5731999999999998e-05 2024-09-12T21:51:27.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676237+0000", 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0903e-05 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.676245+0000", 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3320000000000003e-06 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684707+0000", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084621990000000001 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684887+0000", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018032500000000001 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696492+0000", 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011605153 2024-09-12T21:51:27.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696542+0000", 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9458e-05 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696619+0000", 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7090999999999998e-05 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71699 5.a 5:5ab4becd:::benchmark_data_smithi053_32461_object71698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6884192549999999, 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020503668999999999, 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71699 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.367 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569504+0000", 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569587+0000", 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3487999999999998e-05 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569596+0000", 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8009999999999993e-06 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569601+0000", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4060000000000004e-06 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577278+0000", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076762289999999997 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577398+0000", 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012074399999999999 2024-09-12T21:51:27.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577549+0000", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151056 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.587509+0000", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099601110000000007 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589866+0000", 2024-09-12T21:51:27.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023569530000000002 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589918+0000", 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1187000000000003e-05 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590007+0000", 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.899e-05 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71700 5.2 5:49d9f99f:::benchmark_data_smithi053_32461_object71699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.688287222, 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020461822000000001, 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71700 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569635+0000", 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569636+0000", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5700000000000001e-07 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569711+0000", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5587000000000007e-05 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569719+0000", 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3189999999999997e-06 2024-09-12T21:51:27.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569724+0000", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-06 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580669+0000", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010944980999999999 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580782+0000", 2024-09-12T21:51:27.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113007 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.580921+0000", 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013887700000000001 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589894+0000", 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089733039999999997 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590016+0000", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012229299999999999 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590047+0000", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193999999999999e-05 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590097+0000", 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0272999999999998e-05 2024-09-12T21:51:27.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:72043 5.2 5:460d4ddb:::benchmark_data_smithi053_32461_object72042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5379522460000001, 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020754093000000001, 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:27.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72043 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719971+0000", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720029+0000", 2024-09-12T21:51:27.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8554000000000002e-05 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720042+0000", 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2889e-05 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720049+0000", 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:27.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729266+0000", 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092164710000000004 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729387+0000", 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729557+0000", 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016992600000000001 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.738496+0000", 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089387670000000002 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740587+0000", 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020911359999999999 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:27.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740639+0000", 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740724+0000", 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5148000000000005e-05 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:27.385 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:27.386 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 28 16 75874 75858 169.31 145.625 0.00567887 0.00590333 2024-09-12T21:51:27.387 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:27.385+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:27.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:27.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:27.417 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:51:27.487 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:27.486+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:76275 5.3 e38/21 5:c0686cd7:::benchmark_data_smithi053_32461_object76274:head v 38'4874, mlcod=38'4872)", 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.528523+0000", 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020136830000000001, 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002033651, 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528523+0000", 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528523+0000", 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528524+0000", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.22e-07 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528587+0000", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3575e-05 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528593+0000", 2024-09-12T21:51:27.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5679999999999999e-06 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528596+0000", 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.129e-06 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528629+0000", 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3135e-05 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.528642+0000", 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3118999999999999e-05 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:76278 5.7 5:e62646ee:::benchmark_data_smithi053_32461_object76277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.529200+0000", 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001336872, 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001418971, 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.536 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 76278 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529200+0000", 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529200+0000", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529201+0000", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6700000000000002e-07 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529257+0000", 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6057999999999998e-05 2024-09-12T21:51:27.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529271+0000", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3873000000000001e-05 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529279+0000", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7729999999999999e-06 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529336+0000", 2024-09-12T21:51:27.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7218e-05 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529483+0000", 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014708599999999999 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529629+0000", 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014543 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:76256 5.7 e38/21)", 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.529563+0000", 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00097394300000000001, 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011151259999999999, 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529563+0000", 2024-09-12T21:51:27.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529563+0000", 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529564+0000", 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2600000000000002e-07 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529567+0000", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6540000000000001e-06 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529580+0000", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2676e-05 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529587+0000", 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2559999999999996e-06 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.543 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:76277 5.c e38/21 5:3a3ed926:::benchmark_data_smithi053_32461_object76276:head v 38'4710, mlcod=38'4707)", 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.529740+0000", 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00079712900000000004, 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00098343999999999992, 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529740+0000", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529740+0000", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529740+0000", 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5700000000000002e-07 2024-09-12T21:51:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529795+0000", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4299000000000003e-05 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529803+0000", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0180000000000001e-06 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529808+0000", 2024-09-12T21:51:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0440000000000003e-06 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529847+0000", 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8930000000000002e-05 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529866+0000", 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8958999999999999e-05 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.547 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:76282 5.7 5.438bb7c7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.530245+0000", 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000291649, 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00053499799999999996, 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.548 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 76282 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530245+0000", 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530245+0000", 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530246+0000", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530318+0000", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2020999999999994e-05 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530329+0000", 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0545e-05 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530334+0000", 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6899999999999997e-06 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:76268 5.2 e38/36 5:464a43d8:::benchmark_data_smithi053_32461_object76267:head v 38'4692, mlcod=38'4689)", 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.530606+0000", 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999309, 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00022958200000000001, 2024-09-12T21:51:27.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530606+0000", 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530606+0000", 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530607+0000", 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9999999999999997e-07 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530670+0000", 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3414e-05 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530680+0000", 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043e-05 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530687+0000", 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2829999999999998e-06 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530764+0000", 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7783999999999999e-05 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.530787+0000", 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2099999999999998e-05 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:76256 5.7 5:e14ee522:::benchmark_data_smithi053_32461_object76255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.518293+0000", 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.01224398, 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012602224, 2024-09-12T21:51:27.555 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 76256 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518293+0000", 2024-09-12T21:51:27.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518293+0000", 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518294+0000", 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0500000000000004e-07 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518326+0000", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2583999999999998e-05 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518333+0000", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6019999999999996e-06 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.518338+0000", 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8500000000000002e-06 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.523398+0000", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005060185 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.523514+0000", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116255 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.523597+0000", 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2628999999999998e-05 2024-09-12T21:51:27.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.529186+0000", 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0055893840000000002 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:76262 5.7 5:ee7655ce:::benchmark_data_smithi053_32461_object76261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.522231+0000", 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0083063800000000004, 2024-09-12T21:51:27.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0087374040000000007, 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 76262 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522231+0000", 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522231+0000", 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522232+0000", 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9500000000000001e-07 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522333+0000", 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101938 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522342+0000", 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6850000000000007e-06 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.522349+0000", 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6220000000000003e-06 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524763+0000", 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024139410000000002 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524839+0000", 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5994000000000005e-05 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:27.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524919+0000", 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0642999999999993e-05 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:76271 5.f 5:f6bd2382:::benchmark_data_smithi053_32461_object76270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:27.524705+0000", 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0058325149999999999, 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063310440000000001, 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:27.565 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 76271 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524705+0000", 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524705+0000", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524705+0000", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7199999999999997e-07 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524760+0000", 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4580000000000003e-05 2024-09-12T21:51:27.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524770+0000", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9299999999999998e-06 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.524777+0000", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8210000000000004e-06 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.526291+0000", 2024-09-12T21:51:27.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001514343 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:27.526405+0000", 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114428 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 9 2024-09-12T21:51:27.569 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:27.570 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:27.570 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:27.571 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:27.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:27.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:27.573 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:27.588 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:27.587+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:27.689 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:27.688+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:27.719 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:27.719 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:27.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:27.789 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:27.788+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:27.882 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:27.882 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:27.890 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:27.889+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:27.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:27.991 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:27.989+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.047 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.047 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:28.105 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:28.104+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:28.193 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:28.192+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:28.213 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.216 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:28.314 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:28.313+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:28.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 29 16 78213 78197 168.512 146.188 0.00445007 0.00593132 2024-09-12T21:51:28.395 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:28.393+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.421 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.422 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:28.496 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:28.495+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.584 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.584 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:28.598 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:28.596+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.698 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:28.696+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.778 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.779 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:28.832 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:28.830+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:28.900 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:28.899+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:28.980 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:28.980 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:28.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:29.038 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.037+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.101 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:29.099+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:29.151 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:29.151 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:29.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:29.202 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:29.200+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:29.302 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.301+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 30 16 80562 80546 167.788 146.812 0.00656803 0.00595683 2024-09-12T21:51:29.359 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:29.359 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:29.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:29.414 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.413+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:51:29.498 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:51:29.507 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:29.506+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:29.566 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:29.566 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:29.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:29.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:29.609 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-09-12T21:51:29.609 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-09-12T21:51:29.623 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:29.622+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:29.705 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:29.710 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.708+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.724 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:29.724 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:29.725 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:29.726 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:81387 5.1 5:8a0c9b89:::benchmark_data_smithi053_32461_object81386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:29.722512+0000", 2024-09-12T21:51:29.727 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0035522629999999999, 2024-09-12T21:51:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035722649999999998, 2024-09-12T21:51:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:29.728 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 81387 2024-09-12T21:51:29.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722512+0000", 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722512+0000", 2024-09-12T21:51:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722513+0000", 2024-09-12T21:51:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6199999999999996e-07 2024-09-12T21:51:29.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722576+0000", 2024-09-12T21:51:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3109999999999997e-05 2024-09-12T21:51:29.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722584+0000", 2024-09-12T21:51:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1280000000000008e-06 2024-09-12T21:51:29.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722605+0000", 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0588999999999999e-05 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722646+0000", 2024-09-12T21:51:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1894999999999998e-05 2024-09-12T21:51:29.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722762+0000", 2024-09-12T21:51:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115091 2024-09-12T21:51:29.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.722854+0000", 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2050000000000001e-05 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724702+0000", 2024-09-12T21:51:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001848204 2024-09-12T21:51:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.739 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:81388 5.6 5:6d30efb8:::benchmark_data_smithi053_32461_object81387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:29.740 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:29.724066+0000", 2024-09-12T21:51:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001998316, 2024-09-12T21:51:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020678010000000002, 2024-09-12T21:51:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:29.741 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 81388 2024-09-12T21:51:29.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724066+0000", 2024-09-12T21:51:29.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724066+0000", 2024-09-12T21:51:29.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724067+0000", 2024-09-12T21:51:29.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4099999999999998e-07 2024-09-12T21:51:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:29.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724138+0000", 2024-09-12T21:51:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1395000000000003e-05 2024-09-12T21:51:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:29.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724148+0000", 2024-09-12T21:51:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0152e-05 2024-09-12T21:51:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724155+0000", 2024-09-12T21:51:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4880000000000004e-06 2024-09-12T21:51:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:29.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724210+0000", 2024-09-12T21:51:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5541999999999998e-05 2024-09-12T21:51:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:29.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724340+0000", 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012941800000000001 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.724497+0000", 2024-09-12T21:51:29.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157341 2024-09-12T21:51:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:81391 5.6 5.c5ec85b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:29.725995+0000", 2024-09-12T21:51:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 6.8838999999999996e-05, 2024-09-12T21:51:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000176066, 2024-09-12T21:51:29.753 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:29.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 81391 2024-09-12T21:51:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.725995+0000", 2024-09-12T21:51:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.725995+0000", 2024-09-12T21:51:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.725996+0000", 2024-09-12T21:51:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8199999999999999e-07 2024-09-12T21:51:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.726085+0000", 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8898000000000002e-05 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:29.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.726092+0000", 2024-09-12T21:51:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5020000000000003e-06 2024-09-12T21:51:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:29.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:29.726097+0000", 2024-09-12T21:51:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6550000000000003e-06 2024-09-12T21:51:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:29.762 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 3 2024-09-12T21:51:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:29.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:29.765 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:29.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:29.811 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.810+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.912 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:29.911+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:29.956 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:29.956 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:29.956 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:29.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-12T21:51:29.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:30.013 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:30.012+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:30.114 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.113+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.785631369000001, 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:30.121 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:30.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:30.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:30.127 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.785358801000001, 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:30.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:30.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.785300876000001, 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.134 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:30.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:30.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.784228906999999, 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:30.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:30.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.780680325999999, 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.146 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:30.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:30.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.779363172, 2024-09-12T21:51:30.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:30.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:30.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:30.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:30.158 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.779009096999999, 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:30.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.778401267, 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:30.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:30.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:30.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.778381825, 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.777675332000001, 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.172 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:30.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9719614100000005, 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.177 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:30.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:30.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:30.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66255 5.9 5:99955d20:::benchmark_data_smithi053_32461_object66254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9672131650000004, 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021555047000000001, 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66255 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150773+0000", 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150775+0000", 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.424e-06 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150835+0000", 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000999999999997e-05 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150844+0000", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1989999999999995e-06 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150849+0000", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150905+0000", 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5303000000000002e-05 2024-09-12T21:51:30.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150991+0000", 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6483000000000005e-05 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.151075+0000", 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3931000000000007e-05 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152865+0000", 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001790402 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172225+0000", 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.019359483 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172282+0000", 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7494000000000002e-05 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.172329+0000", 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6142e-05 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66257 5.9 5:98919938:::benchmark_data_smithi053_32461_object66256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.9651150949999998, 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.020800945000000001, 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66257 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152872+0000", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152873+0000", 2024-09-12T21:51:30.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2190000000000001e-06 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152927+0000", 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3758000000000003e-05 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152937+0000", 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0796e-05 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152942+0000", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.023e-06 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.152974+0000", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1466e-05 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153055+0000", 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1237999999999997e-05 2024-09-12T21:51:30.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.153140+0000", 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4484e-05 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.154659+0000", 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015191969999999999 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173591+0000", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.018932458999999999 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173629+0000", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7985000000000003e-05 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.173672+0000", 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3319999999999999e-05 2024-09-12T21:51:30.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8081552340000009, 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.196 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:30.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:30.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.202 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8065338390000001, 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:30.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8064438099999993, 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.209 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:30.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:30.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.214 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8032721089999999, 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:30.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:30.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:30.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.221 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8027518540000003, 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:30.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:30.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.796168368, 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:30.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:30.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:30.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.7835585559999991, 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:30.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:30.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:30.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:30.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:30.240 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:30.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:30.243 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.240+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.343 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.342+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 31 16 82876 82860 167.041 144.625 0.00945773 0.00598396 2024-09-12T21:51:30.404 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82952 5.8 5:1fdc2f20:::benchmark_data_smithi053_32461_object82951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.393162+0000", 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083576290000000001, 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083872310000000002, 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82952 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393162+0000", 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393162+0000", 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393163+0000", 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2799999999999996e-07 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393187+0000", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3978999999999999e-05 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393194+0000", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5120000000000002e-06 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393199+0000", 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3589999999999999e-06 2024-09-12T21:51:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395897+0000", 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026975660000000002 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396011+0000", 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114283 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82954 5.8 5:1489cafb:::benchmark_data_smithi053_32461_object82953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.394811+0000", 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006708716, 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006817203, 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82954 2024-09-12T21:51:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394811+0000", 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394811+0000", 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394812+0000", 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0389999999999999e-06 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394889+0000", 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6860999999999995e-05 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394900+0000", 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0899e-05 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394908+0000", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4500000000000004e-06 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397833+0000", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029244420000000002 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397959+0000", 2024-09-12T21:51:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012686899999999999 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82955 5.2 5:4b90b59f:::benchmark_data_smithi053_32461_object82954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.394935+0000", 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065841889999999998, 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067660239999999998, 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82955 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394935+0000", 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394935+0000", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394936+0000", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394977+0000", 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1337000000000001e-05 2024-09-12T21:51:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394984+0000", 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6460000000000004e-06 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394989+0000", 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4889999999999997e-06 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395031+0000", 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2222999999999999e-05 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395158+0000", 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012740700000000001 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395313+0000", 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015430899999999999 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398575+0000", 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003261959 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82958 5.0 5:0fade8c8:::benchmark_data_smithi053_32461_object82957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.395165+0000", 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006354452, 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066196450000000004, 2024-09-12T21:51:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82958 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395165+0000", 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395165+0000", 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395166+0000", 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4600000000000005e-07 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395190+0000", 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3833e-05 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395197+0000", 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1790000000000002e-06 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395202+0000", 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7189999999999998e-06 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397823+0000", 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026208339999999998 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397963+0000", 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014013799999999999 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82960 5.8 5:14385ef3:::benchmark_data_smithi053_32461_object82959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.395433+0000", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0060867300000000003, 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064630929999999996, 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82960 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395433+0000", 2024-09-12T21:51:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395433+0000", 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395434+0000", 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395547+0000", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113223 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395554+0000", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3950000000000003e-06 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.395560+0000", 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4960000000000004e-06 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401420+0000", 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058599580000000002 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401524+0000", 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104449 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82962 5.b 5:d36db2eb:::benchmark_data_smithi053_32461_object82961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.396497+0000", 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050223630000000002, 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054764159999999996, 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82962 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396497+0000", 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396497+0000", 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396498+0000", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6700000000000002e-07 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396585+0000", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6903000000000005e-05 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396599+0000", 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4126e-05 2024-09-12T21:51:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396607+0000", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1980000000000001e-06 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396667+0000", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9222000000000003e-05 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.396799+0000", 2024-09-12T21:51:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132127 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82964 5.0 5:02037b64:::benchmark_data_smithi053_32461_object82963:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.397970+0000", 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003549703, 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040746699999999999, 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82964 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397970+0000", 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397970+0000", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.397971+0000", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6899999999999996e-07 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398001+0000", 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0311000000000002e-05 2024-09-12T21:51:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398008+0000", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4229999999999999e-06 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398015+0000", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5130000000000002e-06 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401483+0000", 2024-09-12T21:51:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034676860000000002 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401605+0000", 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122027 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82965 5.5 5:aea552d7:::benchmark_data_smithi053_32461_object82964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.398025+0000", 2024-09-12T21:51:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034945589999999999, 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041100420000000004, 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82965 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398025+0000", 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398025+0000", 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398026+0000", 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7299999999999996e-07 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398058+0000", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2149e-05 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398065+0000", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398083+0000", 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8014999999999999e-05 2024-09-12T21:51:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398128+0000", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4948999999999999e-05 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398241+0000", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011328300000000001 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398369+0000", 2024-09-12T21:51:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012816300000000001 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401716+0000", 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003346842 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82966 5.8 5.d4186928 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.398101+0000", 2024-09-12T21:51:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034181760000000002, 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004124478, 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82966 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398101+0000", 2024-09-12T21:51:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398101+0000", 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398102+0000", 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7100000000000002e-07 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398130+0000", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7813999999999998e-05 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398136+0000", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6200000000000001e-06 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398142+0000", 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6119999999999998e-06 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:82963 5.1 e38/36 5:862d5281:::benchmark_data_smithi053_32461_object82962:head v 38'5176, mlcod=38'5174)", 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.398450+0000", 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030691630000000002, 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038246579999999999, 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398450+0000", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398450+0000", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398451+0000", 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398482+0000", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1152999999999998e-05 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398491+0000", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2199999999999998e-06 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398498+0000", 2024-09-12T21:51:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4010000000000002e-06 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398542+0000", 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3989000000000002e-05 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398562+0000", 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9825000000000001e-05 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82967 5.4 5:2f628c5f:::benchmark_data_smithi053_32461_object82966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.398683+0000", 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028361620000000001, 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003647202, 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82967 2024-09-12T21:51:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398683+0000", 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398683+0000", 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398684+0000", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6000000000000003e-07 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398757+0000", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2286999999999994e-05 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398767+0000", 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0053e-05 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398773+0000", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1759999999999998e-06 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398829+0000", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5815e-05 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.398946+0000", 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117786 2024-09-12T21:51:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82968 5.5 5:a08e22ea:::benchmark_data_smithi053_32461_object82967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.400165+0000", 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013546420000000001, 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002225842, 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82968 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400165+0000", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400165+0000", 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400166+0000", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6300000000000005e-07 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400228+0000", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2534999999999997e-05 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400239+0000", 2024-09-12T21:51:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0679000000000001e-05 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.400243+0000", 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0609999999999997e-06 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401744+0000", 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001501025 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401867+0000", 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012281099999999999 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401999+0000", 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013228799999999999 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82970 5.b 5:d0c2cb41:::benchmark_data_smithi053_32461_object82969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.401775+0000", 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997444, 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068361300000000002, 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82970 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401775+0000", 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401775+0000", 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401776+0000", 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2399999999999997e-07 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401865+0000", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8718e-05 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401874+0000", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.054e-06 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401879+0000", 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5050000000000001e-06 2024-09-12T21:51:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.401921+0000", 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2478000000000002e-05 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402016+0000", 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5030000000000003e-05 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82971 5.4 5:2acac841:::benchmark_data_smithi053_32461_object82970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.402110+0000", 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994102, 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041483999999999998, 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82971 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402110+0000", 2024-09-12T21:51:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402110+0000", 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402111+0000", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7000000000000003e-07 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402190+0000", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9228999999999996e-05 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402198+0000", 2024-09-12T21:51:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402205+0000", 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4989999999999999e-06 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402259+0000", 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3990000000000003e-05 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.402366+0000", 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107042 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82948 5.8 5:1185576a:::benchmark_data_smithi053_32461_object82947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.391446+0000", 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010073934, 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011140061, 2024-09-12T21:51:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82948 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391446+0000", 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391446+0000", 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391446+0000", 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4900000000000001e-07 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391481+0000", 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5295e-05 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391490+0000", 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2470000000000008e-06 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391495+0000", 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1529999999999996e-06 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391555+0000", 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0541999999999997e-05 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.391666+0000", 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110247 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:82949 5.8 5:1660cea1:::benchmark_data_smithi053_32461_object82948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.392278+0000", 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0092413519999999996, 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01036779, 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 82949 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392278+0000", 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392278+0000", 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392279+0000", 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.06e-06 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392373+0000", 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3566999999999994e-05 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392384+0000", 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1066999999999999e-05 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.392392+0000", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6210000000000004e-06 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.393961+0000", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015693669999999999 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.394069+0000", 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108261 2024-09-12T21:51:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-09-12T21:51:30.476 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:30.477 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:30.475+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:30.478 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:51:30.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:30.578 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.577+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.677 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:30.677 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:30.678 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:30.676+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:30.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:30.779 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.778+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.880 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:30.879+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:30.893 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.551322266, 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.550000740000002, 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.549512897, 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.548785515999999, 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.542990959000001, 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5819414649999999, 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5818140060000001, 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5817553859999993, 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5796437399999999, 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5779867979999995, 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5770371989999994, 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5728131120000004, 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5704595740000009, 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5688363820000006, 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67461 5.c 5:3916cbf1:::benchmark_data_smithi053_32461_object67460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2181476599999996, 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020671854, 2024-09-12T21:51:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67461 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672900+0000", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672901+0000", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672930+0000", 2024-09-12T21:51:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9240000000000001e-05 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672939+0000", 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1959999999999997e-06 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.672948+0000", 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7110000000000001e-06 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677447+0000", 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044995670000000003 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677520+0000", 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2238999999999997e-05 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.677604+0000", 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4213000000000002e-05 2024-09-12T21:51:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680967+0000", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033630029999999998 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693440+0000", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012473451 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693492+0000", 2024-09-12T21:51:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1924e-05 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.693572+0000", 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9721999999999993e-05 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2163463070000002, 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:71699 5.a 5:5ab4becd:::benchmark_data_smithi053_32461_object71698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3215448099999998, 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020503668999999999, 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71699 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569503+0000", 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569504+0000", 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569587+0000", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3487999999999998e-05 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569596+0000", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8009999999999993e-06 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.569601+0000", 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4060000000000004e-06 2024-09-12T21:51:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577278+0000", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076762289999999997 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577398+0000", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012074399999999999 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.577549+0000", 2024-09-12T21:51:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151056 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.587509+0000", 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099601110000000007 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589866+0000", 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023569530000000002 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.589918+0000", 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1187000000000003e-05 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.590007+0000", 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.899e-05 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:72043 5.2 5:460d4ddb:::benchmark_data_smithi053_32461_object72042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.171077801, 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020754093000000001, 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72043 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719971+0000", 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720029+0000", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8554000000000002e-05 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720042+0000", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2889e-05 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720049+0000", 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729266+0000", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092164710000000004 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729387+0000", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729557+0000", 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016992600000000001 2024-09-12T21:51:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.738496+0000", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089387670000000002 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740587+0000", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020911359999999999 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740639+0000", 2024-09-12T21:51:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740724+0000", 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5148000000000005e-05 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:83294 5.2 5:434222c6:::benchmark_data_smithi053_32461_object83293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.35437757800000003, 2024-09-12T21:51:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020722015999999999, 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83294 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536671+0000", 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536724+0000", 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2930999999999999e-05 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536735+0000", 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0713000000000001e-05 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536743+0000", 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9950000000000005e-06 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544011+0000", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072682900000000002 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544120+0000", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109267 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544252+0000", 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013189699999999999 2024-09-12T21:51:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.550780+0000", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065274629999999998 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557244+0000", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064647000000000003 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557294+0000", 2024-09-12T21:51:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9993000000000001e-05 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557392+0000", 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7874999999999994e-05 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:83295 5.a 5:5f7f72c4:::benchmark_data_smithi053_32461_object83294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.35385347099999997, 2024-09-12T21:51:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020849097, 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83295 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537195+0000", 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3099999999999996e-07 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537256+0000", 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1080999999999993e-05 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537266+0000", 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3219999999999999e-06 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537272+0000", 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5529999999999998e-06 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547293+0000", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010020975999999999 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547420+0000", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012652099999999999 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547562+0000", 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014268700000000001 2024-09-12T21:51:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.552014+0000", 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004451773 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557904+0000", 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058897890000000003 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557954+0000", 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0646000000000003e-05 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.558043+0000", 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8918000000000005e-05 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.020 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:31.022 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.020+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:31.122 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:31.121+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:84754 5.6 e39/36)", 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.169820+0000", 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010043929999999999, 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010220450000000001, 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169820+0000", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169820+0000", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169820+0000", 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999997e-07 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169824+0000", 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3890000000000001e-06 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169833+0000", 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6770000000000007e-06 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.169838+0000", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1910000000000002e-06 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170825+0000", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0009871420000000001 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170833+0000", 2024-09-12T21:51:31.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:84772 5.3 e39/21 5:c1ea7bf9:::benchmark_data_smithi053_32461_object84771:head v 39'5424, mlcod=39'5421)", 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.170191+0000", 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00063329100000000002, 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00071767900000000004, 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:31.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170191+0000", 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170191+0000", 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170192+0000", 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170243+0000", 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0942000000000001e-05 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170253+0000", 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0703999999999999e-05 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170261+0000", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4499999999999998e-06 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170298+0000", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7249000000000002e-05 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170311+0000", 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2773e-05 2024-09-12T21:51:31.179 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84761 5.7 5:e00c7b55:::benchmark_data_smithi053_32461_object84760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.162907+0000", 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0079174280000000007, 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.008057224, 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84761 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162907+0000", 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162907+0000", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162907+0000", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162931+0000", 2024-09-12T21:51:31.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3326999999999999e-05 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162938+0000", 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0840000000000003e-06 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.162941+0000", 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4920000000000002e-06 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.164962+0000", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020203130000000001 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.165102+0000", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014070900000000001 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.165233+0000", 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000130302 2024-09-12T21:51:31.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.167589+0000", 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023564910000000001 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84767 5.6 5:64bb7dd3:::benchmark_data_smithi053_32461_object84766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.166301+0000", 2024-09-12T21:51:31.185 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0045231150000000003, 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047131810000000003, 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84767 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166301+0000", 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166301+0000", 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166302+0000", 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8299999999999996e-07 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166395+0000", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3628999999999994e-05 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166402+0000", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5860000000000001e-06 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166406+0000", 2024-09-12T21:51:31.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2740000000000001e-06 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166450+0000", 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3225e-05 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166525+0000", 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5377999999999996e-05 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.166606+0000", 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0783000000000002e-05 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.170928+0000", 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043224500000000003 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84773 5.6 5:6a5d3218:::benchmark_data_smithi053_32461_object84772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.190 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.168507+0000", 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002317543, 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025700839999999998, 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84773 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168507+0000", 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168507+0000", 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168507+0000", 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168533+0000", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5921000000000001e-05 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168541+0000", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0800000000000006e-06 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168556+0000", 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4294000000000001e-05 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168610+0000", 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3841000000000002e-05 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168769+0000", 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015941499999999999 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.168939+0000", 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017036800000000001 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.171080+0000", 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021405069999999998 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 5 2024-09-12T21:51:31.195 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:31.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:31.241 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.239+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.324 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:31.323+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:31.348 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:31.349 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:31.349 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:31.349 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:31.349 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:31.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 32 16 85213 85197 166.385 146.062 0.00564302 0.00600722 2024-09-12T21:51:31.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:31.446 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.444+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.526 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.524+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.547 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:31.547 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:31.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:31.547 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.212312708999999, 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:31.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:31.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.212040140999999, 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.554 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:31.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.211982215999999, 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.560 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:31.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:31.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.210910247000001, 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:31.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.207361666000001, 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.572 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:31.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:31.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:31.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.206044511999998, 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.579 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:31.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:31.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:31.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.205690437000001, 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:31.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.205082607000001, 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:31.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:31.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.205063164999999, 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:31.596 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:31.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 19.204356671999999, 2024-09-12T21:51:31.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:31.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:31.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.39864275, 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:31.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:31.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.613 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.234836573999999, 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:31.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:31.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233215179, 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.620 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:31.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:31.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.233125149999999, 2024-09-12T21:51:31.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:31.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:31.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.229953449, 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:31.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.229433194, 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.640 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:31.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:31.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.646 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.222849708, 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:31.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:31.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 10.210239895999999, 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.653 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:31.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:31.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.532304004, 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.659 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:31.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:31.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.53198556200000002, 2024-09-12T21:51:31.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:31.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:31.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:31.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:31.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:31.671 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:31.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:31.673 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.670+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:31.772 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.771+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.828 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86311 5.a 5:50d59cf3:::benchmark_data_smithi053_32461_object86310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.820829+0000", 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065852280000000003, 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066080979999999997, 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86311 2024-09-12T21:51:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820829+0000", 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820829+0000", 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820830+0000", 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9699999999999995e-07 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820872+0000", 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1674000000000001e-05 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820885+0000", 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3168e-05 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820894+0000", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7090000000000008e-06 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824999+0000", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041055500000000003 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825141+0000", 2024-09-12T21:51:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014186900000000001 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825285+0000", 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144186 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86314 5.5 5:ab3ca445:::benchmark_data_smithi053_32461_object86313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.822041+0000", 2024-09-12T21:51:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053736119999999998, 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054447699999999998, 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86314 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822041+0000", 2024-09-12T21:51:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822041+0000", 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822042+0000", 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0139999999999999e-06 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822109+0000", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7560999999999999e-05 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822120+0000", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007e-05 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822126+0000", 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5270000000000004e-06 2024-09-12T21:51:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822656+0000", 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053022099999999999 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822767+0000", 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011083599999999999 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822903+0000", 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136363 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.826726+0000", 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038228149999999998 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86316 5.a 5.8ae4492a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.822536+0000", 2024-09-12T21:51:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048782239999999996, 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049889890000000001, 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86316 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822536+0000", 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822536+0000", 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822537+0000", 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7000000000000004e-07 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822565+0000", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7988e-05 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822573+0000", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822579+0000", 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9880000000000001e-06 2024-09-12T21:51:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86318 5.5 5:a860c63b:::benchmark_data_smithi053_32461_object86317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.823464+0000", 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039501040000000003, 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040910410000000001, 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86318 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823464+0000", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823464+0000", 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823465+0000", 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.08e-06 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823521+0000", 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5019999999999998e-05 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823532+0000", 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1953999999999999e-05 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.823540+0000", 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0129999999999993e-06 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824725+0000", 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001184781 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824843+0000", 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117973 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824988+0000", 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144597 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827121+0000", 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021333400000000001 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:86309 5.1 e39/36 5:8c670baa:::benchmark_data_smithi053_32461_object86308:head v 39'5382, mlcod=39'5379)", 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.824505+0000", 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029094490000000001, 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030910740000000001, 2024-09-12T21:51:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824505+0000", 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824505+0000", 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824506+0000", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824566+0000", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0197e-05 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824574+0000", 2024-09-12T21:51:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0499999999999992e-06 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824581+0000", 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3039999999999999e-06 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824637+0000", 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5429000000000001e-05 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.824659+0000", 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2345e-05 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86321 5.4 5:21e20eb6:::benchmark_data_smithi053_32461_object86320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.825043+0000", 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023711019999999999, 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025840350000000002, 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86321 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825043+0000", 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825043+0000", 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825044+0000", 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825074+0000", 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0114e-05 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825084+0000", 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5889999999999992e-06 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825091+0000", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9840000000000004e-06 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825134+0000", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3095e-05 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825242+0000", 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107673 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86323 5.3 5:cd2f618c:::benchmark_data_smithi053_32461_object86322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.825243+0000", 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021715929999999999, 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024189039999999999, 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86323 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825243+0000", 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825243+0000", 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825244+0000", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5000000000000002e-07 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825395+0000", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015172499999999999 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825403+0000", 2024-09-12T21:51:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825408+0000", 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6639999999999997e-06 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825456+0000", 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8349000000000001e-05 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825532+0000", 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6054000000000001e-05 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.825611+0000", 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9060000000000005e-05 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:86319 5.1 e39/36 5:8de40314:::benchmark_data_smithi053_32461_object86318:head v 39'5383, mlcod=39'5379)", 2024-09-12T21:51:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.827357+0000", 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8010000000000002e-05, 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034230600000000001, 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827357+0000", 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827357+0000", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827357+0000", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6199999999999997e-07 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827416+0000", 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9151999999999999e-05 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827425+0000", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4589999999999998e-06 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827430+0000", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0869999999999997e-06 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827475+0000", 2024-09-12T21:51:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5528000000000002e-05 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.827499+0000", 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3283999999999999e-05 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86302 5.2 5:45457d58:::benchmark_data_smithi053_32461_object86301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.817594+0000", 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098208800000000006, 2024-09-12T21:51:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013667, 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86302 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817594+0000", 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817594+0000", 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817594+0000", 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817627+0000", 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2974e-05 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817635+0000", 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4120000000000004e-06 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.817641+0000", 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000004e-06 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822516+0000", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048743049999999998 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822638+0000", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121842 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.822790+0000", 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015268500000000001 2024-09-12T21:51:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:86310 5.5 5:ad68d6ca:::benchmark_data_smithi053_32461_object86309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.820450+0000", 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006964044, 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073178879999999998, 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86310 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820450+0000", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820450+0000", 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820451+0000", 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.13e-07 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820481+0000", 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0037000000000001e-05 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820490+0000", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1300000000000007e-06 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820497+0000", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4489999999999996e-06 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820544+0000", 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7669e-05 2024-09-12T21:51:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820651+0000", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106407 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.820775+0000", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012396400000000001 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.826722+0000", 2024-09-12T21:51:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059469509999999998 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-09-12T21:51:31.875 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:31.876 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.874+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:31.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:31.896 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:31.896 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:31.916 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:31.919 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:31.920 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:31.977 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:31.975+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.029 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.029 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:32.085 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:32.084+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:32.178 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.177+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.197 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.197 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:32.279 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.278+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 33 16 87531 87515 165.732 144.875 0.00617903 0.00603118 2024-09-12T21:51:32.358 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.358 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:32.412 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.410+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:51:32.481 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:32.480+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:32.553 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.554 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:32.609 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.607+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.683 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.681+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:32.711 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.711 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:32.784 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:32.783+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:32.880 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:32.880 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:32.886 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:32.884+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:32.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:32.987 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:32.985+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.088 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.087+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.089 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.089 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:33.189 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.187+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.261 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:33.317 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.315+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 34 16 89843 89827 165.107 144.5 0.00528852 0.00605382 2024-09-12T21:51:33.390 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.389+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.419 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.420 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.428 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:51:33.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:33.519 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.517+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.592 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.591+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.619 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.619 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:33.693 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:33.692+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:33.794 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:33.793+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:33.815 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.815 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:33.895 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.894+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:33.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:33.980 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:33.980 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:33.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:33.996 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:33.995+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:34.049 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:34.067 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:34.070 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:34.071 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:34.097 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.096+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:34.150 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:34.150 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:34.150 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:34.150 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:34.150 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:34.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:34.206 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.205+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:34.299 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.298+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:34.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 35 16 92113 92097 164.443 141.875 0.00625598 0.0060781 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.018586161999998, 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:34.362 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:34.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:34.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.017264636, 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:34.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:34.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.016776792999998, 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.016049412000001, 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:34.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:34.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:34.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.010254854999999, 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:34.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.049205361, 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:34.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.049077902000001, 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:34.403 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:34.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:34.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.049019282, 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:34.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.046907636, 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:34.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.045250694, 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:34.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:34.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.044301095, 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:34.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.040077008000001, 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:34.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:34.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.03772347, 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:34.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:34.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.036100277999999, 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:34.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.683610203000001, 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:34.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:34.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.459 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:72043 5.2 5:460d4ddb:::benchmark_data_smithi053_32461_object72042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6383416969999995, 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020754093000000001, 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72043 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719971+0000", 2024-09-12T21:51:34.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720029+0000", 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8554000000000002e-05 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720042+0000", 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2889e-05 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720049+0000", 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729266+0000", 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092164710000000004 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729387+0000", 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729557+0000", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016992600000000001 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.738496+0000", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089387670000000002 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740587+0000", 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020911359999999999 2024-09-12T21:51:34.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740639+0000", 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740724+0000", 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5148000000000005e-05 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:83294 5.2 5:434222c6:::benchmark_data_smithi053_32461_object83293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8216414739999998, 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020722015999999999, 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83294 2024-09-12T21:51:34.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536670+0000", 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536671+0000", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536724+0000", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2930999999999999e-05 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536735+0000", 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0713000000000001e-05 2024-09-12T21:51:34.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.536743+0000", 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9950000000000005e-06 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544011+0000", 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072682900000000002 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544120+0000", 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109267 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.544252+0000", 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013189699999999999 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.550780+0000", 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065274629999999998 2024-09-12T21:51:34.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557244+0000", 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064647000000000003 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557294+0000", 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9993000000000001e-05 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557392+0000", 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7874999999999994e-05 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:83295 5.a 5:5f7f72c4:::benchmark_data_smithi053_32461_object83294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8211173670000003, 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020849097, 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83295 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537195+0000", 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3099999999999996e-07 2024-09-12T21:51:34.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537256+0000", 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1080999999999993e-05 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537266+0000", 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3219999999999999e-06 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537272+0000", 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5529999999999998e-06 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547293+0000", 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010020975999999999 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547420+0000", 2024-09-12T21:51:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012652099999999999 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547562+0000", 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014268700000000001 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.552014+0000", 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004451773 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557904+0000", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058897890000000003 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557954+0000", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0646000000000003e-05 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.558043+0000", 2024-09-12T21:51:34.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8918000000000005e-05 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.7461717999999999, 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:34.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:34.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.7458855030000002, 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:34.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:34.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:34.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:34.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:34.491 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:34.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:34.493 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:34.490+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:34.593 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.591+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:34.637 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.637 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92750 5.f 5:fff1e1b9:::benchmark_data_smithi053_32461_object92749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.634058+0000", 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001708733, 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017352489999999999, 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92750 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.638 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634058+0000", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634058+0000", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634059+0000", 2024-09-12T21:51:34.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0100000000000003e-07 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634171+0000", 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112367 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634182+0000", 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0373999999999999e-05 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634188+0000", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7240000000000003e-06 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634238+0000", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9599999999999999e-05 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634401+0000", 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016317600000000001 2024-09-12T21:51:34.641 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92751 5.6 5:6155b60c:::benchmark_data_smithi053_32461_object92750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.634243+0000", 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001523702, 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016283789999999999, 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.642 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92751 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634243+0000", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634243+0000", 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634244+0000", 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6499999999999998e-07 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634311+0000", 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7609999999999998e-05 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634319+0000", 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9060000000000002e-06 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634325+0000", 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4240000000000001e-06 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634365+0000", 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0531999999999998e-05 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634502+0000", 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013709799999999999 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634628+0000", 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000125573 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92752 5.1 5:89ec9b2b:::benchmark_data_smithi053_32461_object92751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.634341+0000", 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0014261180000000001, 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001603335, 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92752 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.647 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634341+0000", 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634341+0000", 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634341+0000", 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634417+0000", 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5739000000000001e-05 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634444+0000", 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7664000000000001e-05 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634454+0000", 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1290000000000002e-06 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.635898+0000", 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014447010000000001 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:92745 5.6 e40/36)", 2024-09-12T21:51:34.650 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.634474+0000", 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0012924029999999999, 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001526, 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634474+0000", 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634474+0000", 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634475+0000", 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4700000000000002e-07 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634477+0000", 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6290000000000002e-06 2024-09-12T21:51:34.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634483+0000", 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2910000000000004e-06 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634492+0000", 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9719999999999998e-06 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92753 5.d 5:b5b82896:::benchmark_data_smithi053_32461_object92752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.634511+0000", 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001255663, 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015439519999999999, 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92753 2024-09-12T21:51:34.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634511+0000", 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634511+0000", 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634511+0000", 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3099999999999998e-07 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634550+0000", 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8389999999999997e-05 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634558+0000", 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.695e-06 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634563+0000", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1209999999999998e-06 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634635+0000", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2181000000000006e-05 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634747+0000", 2024-09-12T21:51:34.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112156 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92742 5.6 5:6bf89f13:::benchmark_data_smithi053_32461_object92741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.629912+0000", 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0058544240000000004, 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0062042310000000002, 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.658 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92742 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.629912+0000", 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.629912+0000", 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.629913+0000", 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3300000000000001e-07 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.629997+0000", 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3714000000000005e-05 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630004+0000", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8170000000000001e-06 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630009+0000", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7030000000000003e-06 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630048+0000", 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9202999999999997e-05 2024-09-12T21:51:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630129+0000", 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0325000000000001e-05 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630215+0000", 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5749999999999997e-05 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634072+0000", 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038572469999999998 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:92741 5.5 e40/21 5:a2fc65f4:::benchmark_data_smithi053_32461_object92740:head v 40'5803, mlcod=40'5801)", 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.630052+0000", 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0057145149999999999, 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061406899999999999, 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.663 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630052+0000", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630052+0000", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630053+0000", 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.89e-07 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630138+0000", 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5346999999999994e-05 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630146+0000", 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7579999999999992e-06 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630152+0000", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4019999999999999e-06 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630201+0000", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8928000000000003e-05 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.630223+0000", 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1506e-05 2024-09-12T21:51:34.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92744 5.9 5:908b95b9:::benchmark_data_smithi053_32461_object92743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.631296+0000", 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044704870000000004, 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004935142, 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92744 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631296+0000", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631296+0000", 2024-09-12T21:51:34.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631297+0000", 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3399999999999999e-07 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631336+0000", 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9439e-05 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631344+0000", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6109999999999996e-06 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631349+0000", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7409999999999998e-06 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.633648+0000", 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022989680000000002 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.633761+0000", 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112595 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92745 5.6 5:6fc04e03:::benchmark_data_smithi053_32461_object92744:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.631361+0000", 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044051790000000004, 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049058579999999999, 2024-09-12T21:51:34.671 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92745 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631361+0000", 2024-09-12T21:51:34.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631361+0000", 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631362+0000", 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.75e-07 2024-09-12T21:51:34.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631401+0000", 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8724999999999999e-05 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631409+0000", 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.875e-06 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631414+0000", 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3730000000000001e-06 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631829+0000", 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000414576 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631961+0000", 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000132748 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632102+0000", 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014023599999999999 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92746 5.1 5:8260808f:::benchmark_data_smithi053_32461_object92745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.631426+0000", 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0043410109999999997, 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00487997, 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92746 2024-09-12T21:51:34.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631426+0000", 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631426+0000", 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631426+0000", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5700000000000002e-07 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631463+0000", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6704e-05 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631470+0000", 2024-09-12T21:51:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4880000000000001e-06 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631477+0000", 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0319999999999998e-06 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.633605+0000", 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021279620000000002 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.633715+0000", 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109498 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.633795+0000", 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0210999999999995e-05 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92748 5.7 5:ea9fbd7c:::benchmark_data_smithi053_32461_object92747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.631790+0000", 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0039765859999999998, 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045555020000000003, 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92748 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631790+0000", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631790+0000", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631791+0000", 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8700000000000005e-07 2024-09-12T21:51:34.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631866+0000", 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5612999999999996e-05 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631876+0000", 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6360000000000006e-06 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631882+0000", 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3419999999999996e-06 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631936+0000", 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3977999999999997e-05 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632065+0000", 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012886899999999999 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632184+0000", 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118847 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:92749 5.7 5:ec84ac08:::benchmark_data_smithi053_32461_object92748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:34.631962+0000", 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0038042530000000001, 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044211240000000002, 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:34.686 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 92749 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631962+0000", 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631962+0000", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.631963+0000", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6599999999999996e-07 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632006+0000", 2024-09-12T21:51:34.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2679000000000003e-05 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632013+0000", 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.678e-06 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.632019+0000", 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.378e-06 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:34.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634059+0000", 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002040091 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634200+0000", 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014150600000000001 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:34.634330+0000", 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013004100000000001 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.690 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:34.691 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.691 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:34.691 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:34.691 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 12 2024-09-12T21:51:34.691 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:34.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:34.694 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:34.692+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:34.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-12T21:51:34.711 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-12T21:51:34.711 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:51:34.711 INFO:teuthology.orchestra.console.smithi172:Power on 2024-09-12T21:51:34.711 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T21:51:34.736 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-09-12T21:51:34.796 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:34.794+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:34.837 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:34.837 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:34.837 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:34.838 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:34.838 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:34.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:34.896 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.895+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:34.997 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:34.996+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.698032851000001, 2024-09-12T21:51:35.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:35.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:35.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:35.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.697760283000001, 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.041 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:35.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:35.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:35.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.697702358000001, 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.048 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.696630388999999, 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:35.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:35.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.693081807999999, 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:35.062 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:35.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.691764654, 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.069 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:35.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.691410578999999, 2024-09-12T21:51:35.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.690802748999999, 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:35.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:35.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:35.085 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.690783307, 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:35.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.690076814000001, 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:35.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:35.096 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.884362892, 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:35.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:35.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:35.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:35.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.103 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.720556716000001, 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:35.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:35.110 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.718935321, 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:35.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:35.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.718845291999999, 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.117 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:35.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:35.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.122 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.715673591, 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:35.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:35.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.715153336, 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.130 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:35.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:35.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:35.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:35.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.70856985, 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:35.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:35.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.695960037999999, 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:35.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.0180241460000001, 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.150 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:35.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:35.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.0177057039999999, 2024-09-12T21:51:35.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:35.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:35.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:35.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:35.161 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:35.162 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:35.163 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:35.162+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:35.263 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:35.262+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:35.319 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94328 5.4 5:2bbbab6f:::benchmark_data_smithi053_32461_object94327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.309548+0000", 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083412469999999996, 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083680349999999994, 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94328 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309548+0000", 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309548+0000", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309549+0000", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7499999999999998e-07 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309584+0000", 2024-09-12T21:51:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5562999999999998e-05 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309595+0000", 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1266e-05 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309602+0000", 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9630000000000001e-06 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313569+0000", 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039668079999999996 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313705+0000", 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136031 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94330 5.4 5:2d642ba1:::benchmark_data_smithi053_32461_object94329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.309715+0000", 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081738750000000006, 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083237239999999994, 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94330 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309715+0000", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309715+0000", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309716+0000", 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.75e-07 2024-09-12T21:51:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309760+0000", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4659000000000001e-05 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309767+0000", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8469999999999998e-06 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309772+0000", 2024-09-12T21:51:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2959999999999998e-06 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.316834+0000", 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070615319999999997 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.316961+0000", 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127107 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:94327 5.6 e40/36 5:6d442e35:::benchmark_data_smithi053_32461_object94326:head v 40'5926, mlcod=40'5922)", 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.310436+0000", 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0074530380000000004, 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076659930000000003, 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310436+0000", 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310436+0000", 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310436+0000", 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310462+0000", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5698999999999999e-05 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310474+0000", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1507e-05 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310479+0000", 2024-09-12T21:51:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.874e-06 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310821+0000", 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034154200000000002 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.310840+0000", 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9035999999999999e-05 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94335 5.e 5:780b8344:::benchmark_data_smithi053_32461_object94334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.313888+0000", 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040007610000000002, 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042700439999999997, 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94335 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313888+0000", 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313888+0000", 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313889+0000", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0699999999999996e-07 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313971+0000", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2301999999999999e-05 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313979+0000", 2024-09-12T21:51:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0350000000000001e-06 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.313987+0000", 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2849999999999997e-06 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314029+0000", 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2867000000000001e-05 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314136+0000", 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010678700000000001 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94338 5.0 5:0f3ccda8:::benchmark_data_smithi053_32461_object94337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.314132+0000", 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037567189999999999, 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040884399999999996, 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94338 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314132+0000", 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314132+0000", 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314133+0000", 2024-09-12T21:51:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0500000000000003e-07 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314258+0000", 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012527400000000001 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314267+0000", 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0310000000000004e-06 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314273+0000", 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1709999999999999e-06 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314462+0000", 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189204 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314588+0000", 2024-09-12T21:51:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125046 2024-09-12T21:51:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94339 5.e 5:700fee35:::benchmark_data_smithi053_32461_object94338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.314656+0000", 2024-09-12T21:51:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003232543, 2024-09-12T21:51:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00362482, 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94339 2024-09-12T21:51:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314656+0000", 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314656+0000", 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314657+0000", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1399999999999996e-07 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314956+0000", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000298876 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314966+0000", 2024-09-12T21:51:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0594000000000001e-05 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.314973+0000", 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.316785+0000", 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001811572 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.316925+0000", 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014037399999999999 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94342 5.8 5:129ede10:::benchmark_data_smithi053_32461_object94341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.317175+0000", 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071403600000000003, 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001169881, 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94342 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317175+0000", 2024-09-12T21:51:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317175+0000", 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317176+0000", 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.294e-06 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317237+0000", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1171000000000001e-05 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317247+0000", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9070000000000002e-06 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317261+0000", 2024-09-12T21:51:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3828e-05 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317328+0000", 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7242000000000004e-05 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317444+0000", 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011610799999999999 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94344 5.0 5:0525f393:::benchmark_data_smithi053_32461_object94343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.317285+0000", 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00060417499999999998, 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011289259999999999, 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94344 2024-09-12T21:51:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317285+0000", 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317285+0000", 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317285+0000", 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7299999999999996e-07 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317347+0000", 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2012000000000002e-05 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317357+0000", 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4439999999999997e-06 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317364+0000", 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8569999999999997e-06 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317421+0000", 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6981000000000002e-05 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317534+0000", 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113279 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94345 5.a 5:561aa52a:::benchmark_data_smithi053_32461_object94344:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.317379+0000", 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00051015999999999995, 2024-09-12T21:51:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011001100000000001, 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94345 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317379+0000", 2024-09-12T21:51:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317379+0000", 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317379+0000", 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6599999999999996e-07 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317421+0000", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2055000000000003e-05 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317429+0000", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7239999999999992e-06 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317435+0000", 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5779999999999998e-06 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317483+0000", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8560999999999998e-05 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317619+0000", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135482 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317784+0000", 2024-09-12T21:51:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016513500000000001 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:94346 5.6 e40/36)", 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.317939+0000", 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999499, 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00060087200000000002, 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317939+0000", 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317939+0000", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.317939+0000", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7800000000000001e-07 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.318020+0000", 2024-09-12T21:51:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0742999999999996e-05 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.318031+0000", 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0658e-05 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.318037+0000", 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140000000000004e-06 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94326 5.e 5:7a47c209:::benchmark_data_smithi053_32461_object94325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.308319+0000", 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095701759999999997, 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010267528999999999, 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94326 2024-09-12T21:51:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308319+0000", 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308319+0000", 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308319+0000", 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1299999999999999e-07 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308375+0000", 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.605e-05 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308385+0000", 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3810000000000005e-06 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.308391+0000", 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0190000000000003e-06 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309566+0000", 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011752430000000001 2024-09-12T21:51:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.309897+0000", 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033046200000000001 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:51:35.375 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:35.377 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 36 16 94443 94427 163.92 145.625 0.00493396 0.00609783 2024-09-12T21:51:35.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:35.378 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:35.375+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:51:35.477 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:35.476+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.577 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:35.577 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:35.579 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:35.577+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:35.590 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:35.681 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:35.680+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.781 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:35.780+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:35.786 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.443441657000001, 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.442120130999999, 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.441632288000001, 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:35.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:35.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:35.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.440904907, 2024-09-12T21:51:35.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:35.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:35.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.435110349999999, 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:35.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.474060855999999, 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:35.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.473933397, 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:35.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:35.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.473874777000001, 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:35.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.471763130999999, 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:35.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.470106188999999, 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:35.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:35.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.469156590000001, 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:35.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:35.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:35.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:35.862 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.464932503, 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:35.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:35.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:35.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:35.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.462578965000001, 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:35.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.460955773, 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:35.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:35.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.883 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.108465698, 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:35.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:35.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:72043 5.2 5:460d4ddb:::benchmark_data_smithi053_32461_object72042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.063197192000001, 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020754093000000001, 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72043 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719970+0000", 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.719971+0000", 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720029+0000", 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8554000000000002e-05 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720042+0000", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2889e-05 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.720049+0000", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729266+0000", 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092164710000000004 2024-09-12T21:51:35.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729387+0000", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012162 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.729557+0000", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016992600000000001 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.738496+0000", 2024-09-12T21:51:35.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089387670000000002 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740587+0000", 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020911359999999999 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740639+0000", 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1583999999999999e-05 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:25.740724+0000", 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5148000000000005e-05 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:83295 5.a 5:5f7f72c4:::benchmark_data_smithi053_32461_object83294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2459728620000003, 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020849097, 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83295 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537194+0000", 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537195+0000", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3099999999999996e-07 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537256+0000", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1080999999999993e-05 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537266+0000", 2024-09-12T21:51:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3219999999999999e-06 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.537272+0000", 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5529999999999998e-06 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547293+0000", 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010020975999999999 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547420+0000", 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012652099999999999 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.547562+0000", 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014268700000000001 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.552014+0000", 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004451773 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557904+0000", 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058897890000000003 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.557954+0000", 2024-09-12T21:51:35.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0646000000000003e-05 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:30.558043+0000", 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8918000000000005e-05 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.171027295, 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:35.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1707409980000003, 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:35.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:35.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:35.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94042 5.a 5:584ed8f9:::benchmark_data_smithi053_32461_object94041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:35.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.60440599399999995, 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023272444, 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94042 2024-09-12T21:51:35.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:35.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178762+0000", 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-06 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178860+0000", 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7714999999999995e-05 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178869+0000", 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1130000000000007e-06 2024-09-12T21:51:35.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178876+0000", 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1860000000000003e-06 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.191868+0000", 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012991310000000001 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:35.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192000+0000", 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132006 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192323+0000", 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032316400000000003 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.194616+0000", 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002293729 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201885+0000", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072681000000000004 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201941+0000", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6323000000000003e-05 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.202034+0000", 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2682000000000005e-05 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:35.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:35.926 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:35.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-09-12T21:51:35.927 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:35.925+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:35.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:36.027 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:36.026+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96092 5.d 5:b6b32331:::benchmark_data_smithi053_32461_object96091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064746+0000", 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0049187470000000002, 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049368069999999997, 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96092 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064746+0000", 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064746+0000", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064746+0000", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4099999999999998e-07 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064866+0000", 2024-09-12T21:51:36.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011952500000000001 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064875+0000", 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.935e-06 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064881+0000", 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2910000000000004e-06 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.066632+0000", 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001751126 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.066894+0000", 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026149300000000001 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.075 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:96086 5.5 e40/21 5:ad10b328:::benchmark_data_smithi053_32461_object96085:head v 40'5991, mlcod=40'5988)", 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064772+0000", 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0048918599999999996, 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049517229999999999, 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064772+0000", 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064772+0000", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064773+0000", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2799999999999995e-07 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064918+0000", 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014481800000000001 2024-09-12T21:51:36.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064926+0000", 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7079999999999997e-06 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064930+0000", 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7400000000000004e-06 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.065061+0000", 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013019600000000001 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.065078+0000", 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.717e-05 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96093 5.9 5:9c5d03c2:::benchmark_data_smithi053_32461_object96092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064896+0000", 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0047685729999999999, 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048622739999999998, 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96093 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064896+0000", 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064896+0000", 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064896+0000", 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000004e-07 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064960+0000", 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3419999999999999e-05 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064967+0000", 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4200000000000001e-06 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064972+0000", 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7589999999999997e-06 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068778+0000", 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003806416 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068914+0000", 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013575999999999999 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96094 5.d 5:be425582:::benchmark_data_smithi053_32461_object96093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064979+0000", 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0046848230000000003, 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048142250000000001, 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96094 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064979+0000", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064979+0000", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064980+0000", 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-07 2024-09-12T21:51:36.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.065005+0000", 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5068000000000001e-05 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.065012+0000", 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0330000000000003e-06 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.065017+0000", 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5279999999999997e-06 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068853+0000", 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038368619999999999 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068989+0000", 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013598399999999999 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.088 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96095 5.9 5.9427799 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.067305+0000", 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023587769999999998, 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002521999, 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:36.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96095 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067305+0000", 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067305+0000", 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067306+0000", 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7800000000000001e-07 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067331+0000", 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4343000000000001e-05 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067339+0000", 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5420000000000005e-06 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067345+0000", 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2890000000000003e-06 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96100 5.9 5.e2e9b3a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.067932+0000", 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001732372, 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019224629999999999, 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96100 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.093 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067932+0000", 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067932+0000", 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067933+0000", 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4300000000000003e-07 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068003+0000", 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0936e-05 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068013+0000", 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9790000000000005e-06 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068018+0000", 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7870000000000001e-06 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96101 5.f 5:f20cf795:::benchmark_data_smithi053_32461_object96100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.068036+0000", 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016286619999999999, 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001848164, 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.097 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96101 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068036+0000", 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068036+0000", 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068036+0000", 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.08e-07 2024-09-12T21:51:36.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068070+0000", 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4304999999999998e-05 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068078+0000", 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6769999999999995e-06 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068082+0000", 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9310000000000001e-06 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068130+0000", 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8303999999999997e-05 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068267+0000", 2024-09-12T21:51:36.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013640399999999999 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:96099 5.5 e40/21 5:a0c32953:::benchmark_data_smithi053_32461_object96098:head v 40'5992, mlcod=40'5989)", 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.068308+0000", 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013559150000000001, 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001608679, 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.102 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068308+0000", 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068308+0000", 2024-09-12T21:51:36.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068309+0000", 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3000000000000001e-07 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068372+0000", 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3362999999999996e-05 2024-09-12T21:51:36.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068379+0000", 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.404e-06 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068383+0000", 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0269999999999997e-06 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068828+0000", 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00044578199999999998 2024-09-12T21:51:36.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068848+0000", 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9343000000000001e-05 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96103 5.d 5.72c921ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.068856+0000", 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00080785000000000004, 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010916949999999999, 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96103 2024-09-12T21:51:36.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068856+0000", 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068856+0000", 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068857+0000", 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9100000000000002e-07 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068928+0000", 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0884999999999996e-05 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068939+0000", 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1005999999999999e-05 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.068947+0000", 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3089999999999998e-06 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96081 5.1 5:8f9130cf:::benchmark_data_smithi053_32461_object96080:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.063915+0000", 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.005748838, 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0060627859999999997, 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.111 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96081 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063915+0000", 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063915+0000", 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063916+0000", 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2500000000000004e-07 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063967+0000", 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0441e-05 2024-09-12T21:51:36.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063977+0000", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0266e-05 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.063985+0000", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6340000000000001e-06 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064028+0000", 2024-09-12T21:51:36.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3223999999999998e-05 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064150+0000", 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121834 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064288+0000", 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013818500000000001 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:36.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.067664+0000", 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033757869999999999 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96085 5.d 5:bc19bc2c:::benchmark_data_smithi053_32461_object96084:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064223+0000", 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0054412180000000003, 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005800866, 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.117 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96085 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064223+0000", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064223+0000", 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064224+0000", 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.37e-07 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064257+0000", 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3039e-05 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064265+0000", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2930000000000001e-06 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064272+0000", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7270000000000001e-06 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064336+0000", 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4213000000000003e-05 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064473+0000", 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013661899999999999 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:96087 5.9 5:9aa9eb70:::benchmark_data_smithi053_32461_object96086:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:36.064288+0000", 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0053763220000000002, 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057961890000000002, 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:36.121 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 96087 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064288+0000", 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064288+0000", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064288+0000", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2900000000000004e-07 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064314+0000", 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5865999999999999e-05 2024-09-12T21:51:36.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064321+0000", 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6290000000000004e-06 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.064327+0000", 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6250000000000004e-06 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:36.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.066461+0000", 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021341419999999999 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:36.066618+0000", 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000157217 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 12 2024-09-12T21:51:36.125 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:36.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:36.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:36.128 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:36.127+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:36.230 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:36.228+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:36.258 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:36.268 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:36.268 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:36.277 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:36.277 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:36.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:36.281 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:36.281 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:36.330 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:36.328+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:36.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 37 16 96776 96760 163.431 145.812 0.00534158 0.00611604 2024-09-12T21:51:36.426 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:36.427 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:36.427 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:51:36.432 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:36.430+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:36.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:36.532 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:36.530+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:36.597 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:36.597 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:36.612 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:36.656 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:36.655+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:36.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:36.732+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:36.768 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:36.769 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:36.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:36.835 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:36.833+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:36.935 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:36.934+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:36.974 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:36.974 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:36.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:37.037 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.036+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.129 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.129 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.138 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.137+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:37.239 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.238+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.285 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.285 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:37.340 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.339+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 38 16 99071 99055 162.904 143.438 0.00615192 0.00613588 2024-09-12T21:51:37.441 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.441 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.441 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:37.439+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:37.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:37.542 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.541+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.605 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.605 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:37.660 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.659+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.743 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:37.741+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:37.815 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.816 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:37.843 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:37.842+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:37.944 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:37.943+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:37.976 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:37.976 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:37.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:38.046 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.045+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.129 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:38.129 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:38.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:38.186 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:38.185+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:38.247 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.246+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.283 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:38.287 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:38.287 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:38.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:38.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 39 16 101355 101339 162.387 142.75 0.00643989 0.0061555 2024-09-12T21:51:38.381 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:38.380+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:38.414 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:38.414 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:38.433 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:38.434 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:38.434 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:38.437 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:38.438 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:38.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:51:38.448 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.447+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.490 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:38.490 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:38.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:38.490 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:38.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.155034202, 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.491 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:38.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:38.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:38.497 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.154761634, 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:38.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:38.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.504 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.154703709, 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:38.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:38.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:38.511 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.153631740000002, 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:38.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:38.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.150083159000001, 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.518 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:38.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:38.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:38.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.148766004999999, 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.524 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:38.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.148411930000002, 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.533 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.147804099999998, 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:38.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.147784657999999, 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:38.538 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:38.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.147078165, 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:38.542 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:38.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.546 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.341364243000001, 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.547 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:38.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.553 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.177558067, 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.554 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:38.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:38.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:38.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.175936671999999, 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:38.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:38.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.175846643, 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:38.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.172674942, 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.572 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:38.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:38.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.172154686999999, 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:38.578 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:38.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:38.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:38.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.584 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.165571200999999, 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:38.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:38.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.152961389000001, 2024-09-12T21:51:38.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:38.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:38.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.4750254969999999, 2024-09-12T21:51:38.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:38.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:38.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:38.602 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.4747070549999997, 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:38.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:38.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:38.608 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:38.608 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:38.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:38.610 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.608+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.710 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:38.708+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:38.737 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102287 5.2 5:4253c172:::benchmark_data_smithi053_32461_object102286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.752878+0000", 2024-09-12T21:51:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062585430000000001, 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062805710000000004, 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102287 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752878+0000", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752878+0000", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752879+0000", 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3900000000000003e-07 2024-09-12T21:51:38.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752915+0000", 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5240000000000001e-05 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752925+0000", 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9699999999999994e-06 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752932+0000", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753977+0000", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010451810000000001 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754091+0000", 2024-09-12T21:51:38.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011446399999999999 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754240+0000", 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014857100000000001 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758645+0000", 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044048009999999999 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:102286 5.6 e41/36 5:6f1f04ee:::benchmark_data_smithi053_32461_object102285:head v 41'6395, mlcod=41'6392)", 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.752951+0000", 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061860800000000001, 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062692470000000004, 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752951+0000", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752951+0000", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752951+0000", 2024-09-12T21:51:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7000000000000005e-07 2024-09-12T21:51:38.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752983+0000", 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1071000000000001e-05 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752990+0000", 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9740000000000002e-06 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.752996+0000", 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3859999999999998e-06 2024-09-12T21:51:38.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753529+0000", 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000532955 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753573+0000", 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4603e-05 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:102288 5.1 e41/36 5:8c7e4ded:::benchmark_data_smithi053_32461_object102287:head v 41'6351, mlcod=41'6349)", 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.753009+0000", 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061278859999999999, 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062430760000000002, 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753009+0000", 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753009+0000", 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753009+0000", 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7500000000000001e-07 2024-09-12T21:51:38.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753036+0000", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6183e-05 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753044+0000", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1859999999999992e-06 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753048+0000", 2024-09-12T21:51:38.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3900000000000003e-06 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753103+0000", 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4623999999999997e-05 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753126+0000", 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3632999999999999e-05 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102291 5.b 5:d7c6d64a:::benchmark_data_smithi053_32461_object102290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.754101+0000", 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050355319999999997, 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051836470000000004, 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102291 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754101+0000", 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754101+0000", 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754102+0000", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0410000000000001e-06 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754129+0000", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6265e-05 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754139+0000", 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9490000000000008e-06 2024-09-12T21:51:38.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.754145+0000", 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6640000000000001e-06 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755161+0000", 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001015981 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755279+0000", 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011757200000000001 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102294 5.4 5:249e0533:::benchmark_data_smithi053_32461_object102293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.755567+0000", 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003570321, 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037571499999999999, 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102294 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755567+0000", 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755567+0000", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755568+0000", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.297e-06 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755635+0000", 2024-09-12T21:51:38.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168999999999993e-05 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755642+0000", 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.238e-06 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755647+0000", 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6890000000000003e-06 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755793+0000", 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014600099999999999 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.755890+0000", 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7093e-05 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102297 5.0 5:09e93c27:::benchmark_data_smithi053_32461_object102296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.756374+0000", 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027629590000000002, 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002984352, 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102297 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756374+0000", 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756374+0000", 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756375+0000", 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756441+0000", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6606000000000006e-05 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756452+0000", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.046e-05 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756459+0000", 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8789999999999997e-06 2024-09-12T21:51:38.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756501+0000", 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2519999999999999e-05 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756638+0000", 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013630700000000001 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102298 5.2 5:4b8577a8:::benchmark_data_smithi053_32461_object102297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.756506+0000", 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002630584, 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028859419999999998, 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102298 2024-09-12T21:51:38.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756506+0000", 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756506+0000", 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756507+0000", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756572+0000", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5357999999999993e-05 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756582+0000", 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5559999999999996e-06 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756587+0000", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3460000000000001e-06 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756632+0000", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4289000000000002e-05 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756748+0000", 2024-09-12T21:51:38.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116605 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.756913+0000", 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000164659 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102301 5.5 5:a1fc63e7:::benchmark_data_smithi053_32461_object102300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.758761+0000", 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00037599500000000001, 2024-09-12T21:51:38.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067071100000000005, 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102301 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758761+0000", 2024-09-12T21:51:38.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758761+0000", 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758762+0000", 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6199999999999997e-07 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758814+0000", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2227e-05 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758822+0000", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0039999999999999e-06 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758826+0000", 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2209999999999999e-06 2024-09-12T21:51:38.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758867+0000", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0580000000000001e-05 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.758959+0000", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1785000000000003e-05 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759039+0000", 2024-09-12T21:51:38.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9998000000000002e-05 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:102299 5.1 e41/36 5:8b275801:::benchmark_data_smithi053_32461_object102298:head v 41'6352, mlcod=41'6349)", 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.759062+0000", 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4569999999999999e-05, 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040476299999999999, 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759062+0000", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759062+0000", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759063+0000", 2024-09-12T21:51:38.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.99e-07 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759122+0000", 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9132999999999998e-05 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759136+0000", 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3718e-05 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759142+0000", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1809999999999998e-06 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759192+0000", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0015999999999997e-05 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.759206+0000", 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3692999999999999e-05 2024-09-12T21:51:38.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:102280 5.4 5:2f6b2b91:::benchmark_data_smithi053_32461_object102279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:38.749714+0000", 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094232659999999996, 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097849270000000006, 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:38.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 102280 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749714+0000", 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749714+0000", 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:38.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749715+0000", 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0699999999999996e-07 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749771+0000", 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6311999999999999e-05 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:38.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749780+0000", 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6989999999999992e-06 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.749786+0000", 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5180000000000001e-06 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753659+0000", 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038730489999999999 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:38.753818+0000", 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158572 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-09-12T21:51:38.806 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:38.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:38.811 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.810+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.847 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-09-12T21:51:38.912 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:38.910+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:38.960 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:38.960 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:38.960 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:38.960 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:38.960 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:38.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:39.013 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.011+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:39.115 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.113+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:39.178 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:39.178 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:39.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.835062526000002, 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:39.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:39.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.833741, 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:39.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.191 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.833253157000001, 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:39.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:39.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.198 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.832525776000001, 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:39.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:39.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.826731218999999, 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:39.205 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:39.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:39.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:39.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:39.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.865681725000002, 2024-09-12T21:51:39.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:39.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:39.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:39.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.219 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.865554266, 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:39.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:39.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:39.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.225 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:39.226 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.865495645999999, 2024-09-12T21:51:39.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:39.226 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:39.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:39.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.863384, 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:39.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:39.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:39.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.861727058, 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:39.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:39.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.860777459000001, 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:39.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.856553372, 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:39.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:39.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.854199833999999, 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:39.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:39.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:39.269 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.852576641999999, 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:39.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:67468 5.c 5:3889f5b0:::benchmark_data_smithi053_32461_object67467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T21:51:39.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.500086567, 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021778668000000001, 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67468 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674701+0000", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674702+0000", 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:51:39.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674730+0000", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8098000000000001e-05 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674740+0000", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.674747+0000", 2024-09-12T21:51:39.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.680997+0000", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062504500000000003 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681110+0000", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011246700000000001 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.681247+0000", 2024-09-12T21:51:39.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013759500000000001 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.684673+0000", 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034256960000000002 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696387+0000", 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011714469999999999 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696436+0000", 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8486999999999998e-05 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.696480+0000", 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4227999999999997e-05 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:39.281 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.5626481639999996, 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:39.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.286 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.5623618669999999, 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:39.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:39.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94042 5.a 5:584ed8f9:::benchmark_data_smithi053_32461_object94041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.996026863, 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023272444, 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94042 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178762+0000", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-06 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178860+0000", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7714999999999995e-05 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178869+0000", 2024-09-12T21:51:39.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1130000000000007e-06 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178876+0000", 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1860000000000003e-06 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.191868+0000", 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012991310000000001 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192000+0000", 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132006 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192323+0000", 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032316400000000003 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.194616+0000", 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002293729 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201885+0000", 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072681000000000004 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201941+0000", 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6323000000000003e-05 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.202034+0000", 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2682000000000005e-05 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.083882043000000003, 2024-09-12T21:51:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:39.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:39.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:39.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103070 5.a 5:5e1cbcf1:::benchmark_data_smithi053_32461_object103069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.071424249999999995, 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022556749000000001, 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:39.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103070 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:39.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0999999999999998e-07 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103476+0000", 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112009 2024-09-12T21:51:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103484+0000", 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1570000000000003e-06 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103490+0000", 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1589999999999998e-06 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.112695+0000", 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092053269999999993 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.112852+0000", 2024-09-12T21:51:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015665500000000001 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.113036+0000", 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018439300000000001 2024-09-12T21:51:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115473+0000", 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024370189999999999 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125770+0000", 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010296539 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125831+0000", 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1258000000000002e-05 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125921+0000", 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9623000000000006e-05 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:39.314 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:39.316 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:39.313+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:39.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:39.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:2024-09-12T21:51:39.357810+0000 min lat: 0.00117781 max lat: 1.16496 avg lat: 0.00617346 2024-09-12T21:51:39.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T21:51:39.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 40 15 103646 103631 161.909 143.25 0.00359222 0.00617346 2024-09-12T21:51:39.416 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:39.414+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:39.442 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:51:39.465 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:39.465 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:39.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:103884 5.6 5:66be4dd1:::benchmark_data_smithi053_32461_object103883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:39.462768+0000", 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023216069999999998, 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023403830000000001, 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.466 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 103884 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462768+0000", 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462768+0000", 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462769+0000", 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2900000000000002e-07 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462824+0000", 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5232000000000002e-05 2024-09-12T21:51:39.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462832+0000", 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8979999999999996e-06 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462836+0000", 2024-09-12T21:51:39.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1200000000000004e-06 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462864+0000", 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7776999999999998e-05 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.462951+0000", 2024-09-12T21:51:39.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7182999999999995e-05 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463035+0000", 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3627000000000004e-05 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.464883+0000", 2024-09-12T21:51:39.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018485800000000001 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:103889 5.d 5:bb658b15:::benchmark_data_smithi053_32461_object103888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:39.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:39.463100+0000", 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019898519999999999, 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020577099999999999, 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 103889 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463100+0000", 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463100+0000", 2024-09-12T21:51:39.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463100+0000", 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4700000000000001e-07 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463202+0000", 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101797 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463210+0000", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4479999999999997e-06 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463216+0000", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1460000000000001e-06 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463265+0000", 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9057000000000001e-05 2024-09-12T21:51:39.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463351+0000", 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6007999999999994e-05 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:103890 5.c e42/21 5:32a6f97f:::benchmark_data_smithi053_32461_object103889:head v 42'6424, mlcod=41'6422)", 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:39.463671+0000", 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001419123, 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001522357, 2024-09-12T21:51:39.477 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463671+0000", 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463671+0000", 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463671+0000", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5700000000000002e-07 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463737+0000", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5879999999999999e-05 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463747+0000", 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9150000000000008e-06 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463755+0000", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9759999999999995e-06 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463809+0000", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3498999999999997e-05 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:39.463826+0000", 2024-09-12T21:51:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7825999999999998e-05 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 3 2024-09-12T21:51:39.481 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:39.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:39.525 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.524+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:39.618 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.616+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:39.626 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:39.627 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:39.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:39.718 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:39.716+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:39.819 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.817+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.495042037000001, 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:39.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:39.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.836 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.494769469000001, 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:39.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:39.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:39.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.844 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.494711544000001, 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.845 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.493639575, 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.852 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:39.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.490090993999999, 2024-09-12T21:51:39.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:39.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:39.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:39.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.48877384, 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.866 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:39.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:39.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:39.872 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.488419765, 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:39.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.487811935, 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.877 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.487792493000001, 2024-09-12T21:51:39.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:39.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:39.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.487086000000001, 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:39.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:39.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:39.891 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.681372077999999, 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:39.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:39.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:39.897 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.517565902000001, 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.903 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.515944507, 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.904 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:39.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:39.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:39.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.515854478000001, 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:39.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:39.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:39.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.512682776999998, 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:39.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:39.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.512162522000001, 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.925 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.505579036, 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:39.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:39.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:39.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:39.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 18.492969223999999, 2024-09-12T21:51:39.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.939 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:39.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:39.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:39.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8150333320000005, 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.945 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:39.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:39.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.8147148899999994, 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:39.959 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:39.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:39.961 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:39.958+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.061 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.059+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.117 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105403 5.0 5:06985573:::benchmark_data_smithi053_32461_object105402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114647+0000", 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011311330000000001, 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011578560000000001, 2024-09-12T21:51:40.118 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105403 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114647+0000", 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114647+0000", 2024-09-12T21:51:40.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114648+0000", 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.68e-07 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114674+0000", 2024-09-12T21:51:40.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6012000000000001e-05 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114682+0000", 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8560000000000007e-06 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114687+0000", 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7250000000000002e-06 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114758+0000", 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0653000000000003e-05 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114880+0000", 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121592 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105386 5.3 5:c23bf0db:::benchmark_data_smithi053_32461_object105385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.108093+0000", 2024-09-12T21:51:40.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.007685285, 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077920760000000002, 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105386 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108093+0000", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108093+0000", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108094+0000", 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9599999999999999e-07 2024-09-12T21:51:40.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108155+0000", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1011999999999998e-05 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108164+0000", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2140000000000002e-06 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108169+0000", 2024-09-12T21:51:40.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108217+0000", 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8179000000000001e-05 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108328+0000", 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011077 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108453+0000", 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012529699999999999 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.111109+0000", 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002655597 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105389 5.a 5:599f055d:::benchmark_data_smithi053_32461_object105388:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.110736+0000", 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050419569999999997, 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052303139999999998, 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105389 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110736+0000", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110736+0000", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110737+0000", 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1500000000000003e-07 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110804+0000", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6940999999999995e-05 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110813+0000", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1609999999999992e-06 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110819+0000", 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1109999999999999e-06 2024-09-12T21:51:40.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110864+0000", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5590000000000002e-05 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110956+0000", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1493e-05 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.111043+0000", 2024-09-12T21:51:40.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7529999999999997e-05 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105393 5.3 5:c3cc16e9:::benchmark_data_smithi053_32461_object105392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113171+0000", 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026074100000000001, 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002876497, 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105393 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113171+0000", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113171+0000", 2024-09-12T21:51:40.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113172+0000", 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113222+0000", 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9636999999999999e-05 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113234+0000", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1883e-05 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113241+0000", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3810000000000001e-06 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113293+0000", 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1688999999999999e-05 2024-09-12T21:51:40.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113494+0000", 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020085 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113634+0000", 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140569 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105394 5.b 5:d5dd2fe8:::benchmark_data_smithi053_32461_object105393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113267+0000", 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025111249999999999, 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028672099999999998, 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105394 2024-09-12T21:51:40.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113267+0000", 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113267+0000", 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113268+0000", 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7299999999999995e-07 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113299+0000", 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0741000000000003e-05 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113309+0000", 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0718e-05 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113327+0000", 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7376000000000001e-05 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113397+0000", 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9969999999999996e-05 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113585+0000", 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018836499999999999 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105368 5.a 5:50e6267e:::benchmark_data_smithi053_32461_object105367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.097215+0000", 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.018563570000000001, 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018989961, 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105368 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097215+0000", 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097215+0000", 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097215+0000", 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6100000000000001e-07 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097336+0000", 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012087900000000001 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097344+0000", 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6690000000000006e-06 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097350+0000", 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6960000000000002e-06 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108489+0000", 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011139530999999999 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108616+0000", 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012669100000000001 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.108793+0000", 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017706300000000001 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113634+0000", 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004840652 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105395 5.3 5:c40bca06:::benchmark_data_smithi053_32461_object105394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113799+0000", 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019796449999999999, 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024878959999999999, 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105395 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113799+0000", 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113799+0000", 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113800+0000", 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0640000000000001e-06 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113829+0000", 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9269e-05 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113839+0000", 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0299000000000001e-05 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113847+0000", 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6109999999999996e-06 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.115575+0000", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017283929999999999 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.115687+0000", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111852 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.115815+0000", 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012783299999999999 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105396 5.a 5.52a4ccca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113865+0000", 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001913484, 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024911069999999998, 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105396 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113865+0000", 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113865+0000", 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113865+0000", 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113892+0000", 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113900+0000", 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2130000000000008e-06 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113906+0000", 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-12T21:51:40.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105397 5.3 5.7172743 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113916+0000", 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001861995, 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024915279999999998, 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105397 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113916+0000", 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113916+0000", 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113917+0000", 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6499999999999999e-07 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113943+0000", 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6293000000000001e-05 2024-09-12T21:51:40.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113951+0000", 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113957+0000", 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:105389 5.a e42/36)", 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.113977+0000", 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018014560000000001, 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024721719999999999, 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113977+0000", 2024-09-12T21:51:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113977+0000", 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113977+0000", 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.08e-07 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113979+0000", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1380000000000001e-06 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113987+0000", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6340000000000001e-06 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.113992+0000", 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9779999999999996e-06 2024-09-12T21:51:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105399 5.3 5.64090373 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114216+0000", 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001561864, 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022562939999999998, 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105399 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114216+0000", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114216+0000", 2024-09-12T21:51:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114217+0000", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1800000000000005e-07 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114320+0000", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102632 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114367+0000", 2024-09-12T21:51:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6789999999999998e-05 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114377+0000", 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0154e-05 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105400 5.3 5.eb9ce883 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114390+0000", 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001388521, 2024-09-12T21:51:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002109681, 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105400 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114390+0000", 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114390+0000", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114390+0000", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114441+0000", 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.075e-05 2024-09-12T21:51:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114450+0000", 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4789999999999996e-06 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114456+0000", 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9649999999999996e-06 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105401 5.4 5:2c79e98d:::benchmark_data_smithi053_32461_object105400:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114466+0000", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001312819, 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020630840000000002, 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105401 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114466+0000", 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114466+0000", 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114466+0000", 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1099999999999996e-07 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114499+0000", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2598000000000002e-05 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114505+0000", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.652e-06 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114510+0000", 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9749999999999998e-06 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114547+0000", 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7063000000000001e-05 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114663+0000", 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115213 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105402 5.a 5.95c8dcca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114524+0000", 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012542670000000001, 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020361810000000002, 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105402 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114524+0000", 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114524+0000", 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114525+0000", 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5400000000000001e-07 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114552+0000", 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7124e-05 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114558+0000", 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.657e-06 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114564+0000", 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:105398 5.7 e42/21 5:eddfeeda:::benchmark_data_smithi053_32461_object105397:head v 42'6603, mlcod=42'6601)", 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.114269+0000", 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015097380000000001, 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023246819999999998, 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114269+0000", 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114269+0000", 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114269+0000", 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999998e-07 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114609+0000", 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034054099999999998 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114616+0000", 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9439999999999999e-06 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114621+0000", 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114665+0000", 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3433000000000002e-05 2024-09-12T21:51:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.114683+0000", 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8533e-05 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-09-12T21:51:40.183 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:40.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:40.186 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.183+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.286 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:40.283+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:40.341 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:40.342 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:40.355 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:40.357 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 41 16 105966 105950 161.494 144.938 0.00583481 0.00618949 2024-09-12T21:51:40.386 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.384+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:40.487 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:40.485+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:40.553 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.211274525, 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:40.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:40.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:40.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.209952998999999, 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:40.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.209465156, 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:40.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:40.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.208737774999999, 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:40.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:40.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.202943218000001, 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:40.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:40.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.241893724000001, 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:40.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.241766264999999, 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.241707645000002, 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.239595998999999, 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.237939056999998, 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.236989458, 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.232765370999999, 2024-09-12T21:51:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.230411833000002, 2024-09-12T21:51:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.228788641000001, 2024-09-12T21:51:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9388601629999993, 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9385738660000005, 2024-09-12T21:51:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94042 5.a 5:584ed8f9:::benchmark_data_smithi053_32461_object94041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3722388619999997, 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023272444, 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94042 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178762+0000", 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-06 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178860+0000", 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7714999999999995e-05 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178869+0000", 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1130000000000007e-06 2024-09-12T21:51:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178876+0000", 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1860000000000003e-06 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.191868+0000", 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012991310000000001 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192000+0000", 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132006 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192323+0000", 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032316400000000003 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.194616+0000", 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002293729 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201885+0000", 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072681000000000004 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201941+0000", 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6323000000000003e-05 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.202034+0000", 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2682000000000005e-05 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4600940419999999, 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103070 5.a 5:5e1cbcf1:::benchmark_data_smithi053_32461_object103069:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4476362489999999, 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022556749000000001, 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103070 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103364+0000", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0999999999999998e-07 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103476+0000", 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112009 2024-09-12T21:51:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103484+0000", 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1570000000000003e-06 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.103490+0000", 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1589999999999998e-06 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.112695+0000", 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092053269999999993 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.112852+0000", 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015665500000000001 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.113036+0000", 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018439300000000001 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115473+0000", 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024370189999999999 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125770+0000", 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010296539 2024-09-12T21:51:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125831+0000", 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1258000000000002e-05 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.125921+0000", 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9623000000000006e-05 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105346 5.a 5:540ff5c7:::benchmark_data_smithi053_32461_object105345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46195680900000002, 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023934706, 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105346 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089044+0000", 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089224+0000", 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179636 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089233+0000", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3689999999999996e-06 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089240+0000", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097718+0000", 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084781890000000006 2024-09-12T21:51:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097868+0000", 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015013200000000001 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.098063+0000", 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194802 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110498+0000", 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435827 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112830+0000", 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023316470000000001 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112891+0000", 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0609000000000002e-05 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112978+0000", 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7162000000000003e-05 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:40.693 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:40.694 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:40.695 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.692+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.695 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:40.695 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:40.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:40.696 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:40.697 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:40.697 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:40.697 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:40.796 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.794+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.840 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:40.841 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:40.854 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:40.896 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:40.895+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:40.997 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:40.995+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.042 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.042 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:41.098 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.096+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.199 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.199 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.199 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:41.197+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:41.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:41.300 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:41.298+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:41.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 42 16 108267 108251 161.073 143.812 0.00521129 0.0062057 2024-09-12T21:51:41.371 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.371 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:41.401 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:41.399+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:41.457 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:51:41.502 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.500+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.535 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.536 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:41.634 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.632+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.704 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.701+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-09-12T21:51:41.745 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.745 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:41.804 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.802+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.901 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:41.901 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:41.905 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:41.903+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:41.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:42.006 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:42.004+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:42.047 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:42.047 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:42.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:42.109 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:42.107+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:42.204 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:42.205 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:42.210 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:42.208+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:42.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:42.310 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:42.308+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:42.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 43 16 110534 110518 160.622 141.688 0.00727657 0.0062233 2024-09-12T21:51:42.377 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:42.377 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:42.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:42.431 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:42.429+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:42.445 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:51:42.512 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:42.510+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:42.582 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:42.583 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:42.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:42.639 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:42.637+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:42.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:42.713 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:42.711+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:42.757 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:42.757 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:42.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:42.814 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:42.813+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:42.824 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:42.825 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:42.843 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:42.847 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:42.847 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:42.849 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:51:42.916 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:42.914+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:42.920 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111792 5.7 5:ea52149d:::benchmark_data_smithi053_32461_object111791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.907422+0000", 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011711444999999999, 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011728870000000001, 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:42.921 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111792 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907422+0000", 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907422+0000", 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907423+0000", 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6700000000000003e-07 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907498+0000", 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5087999999999997e-05 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907509+0000", 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0631999999999999e-05 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907516+0000", 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4839999999999998e-06 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915897+0000", 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083804199999999995 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915983+0000", 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6329000000000006e-05 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916068+0000", 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5101999999999999e-05 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111794 5.7 5:ed8dae01:::benchmark_data_smithi053_32461_object111793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.907529+0000", 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.011605107, 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.011682263999999999, 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111794 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907529+0000", 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907529+0000", 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907529+0000", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907587+0000", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7373000000000001e-05 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907594+0000", 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5159999999999997e-06 2024-09-12T21:51:42.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.907598+0000", 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0910000000000003e-06 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.917915+0000", 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010317125 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918047+0000", 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013209100000000001 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918185+0000", 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013804900000000001 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.931 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111799 5.7 5.8cfcd047 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.908975+0000", 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.010158432, 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010303015, 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111799 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.908975+0000", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.908975+0000", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.908976+0000", 2024-09-12T21:51:42.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9800000000000003e-07 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.909031+0000", 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5024e-05 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.909039+0000", 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8290000000000008e-06 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.909043+0000", 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5709999999999999e-06 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111807 5.1 5:82b24752:::benchmark_data_smithi053_32461_object111806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.912294+0000", 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0068401909999999998, 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007027607, 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111807 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912294+0000", 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912294+0000", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912294+0000", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1800000000000005e-07 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912354+0000", 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9926999999999997e-05 2024-09-12T21:51:42.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912363+0000", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6880000000000005e-06 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912370+0000", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4440000000000002e-06 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912428+0000", 2024-09-12T21:51:42.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7194000000000002e-05 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912580+0000", 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000152471 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912759+0000", 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017908600000000001 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:42.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918671+0000", 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059120730000000003 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919252+0000", 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058065700000000005 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919284+0000", 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2376999999999998e-05 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.940 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111786 5.7 5:e1db6239:::benchmark_data_smithi053_32461_object111785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.903186+0000", 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015947249, 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.016195319, 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.941 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111786 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903186+0000", 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903186+0000", 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903187+0000", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.95e-07 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903259+0000", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1823000000000007e-05 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903270+0000", 2024-09-12T21:51:42.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0742e-05 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903276+0000", 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1840000000000004e-06 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.911728+0000", 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084513739999999993 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.911874+0000", 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014601699999999999 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.912018+0000", 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014413800000000001 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111808 5.6 5:625ee4f7:::benchmark_data_smithi053_32461_object111807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.913876+0000", 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0052574500000000003, 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005527522, 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111808 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.946 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913876+0000", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913876+0000", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913877+0000", 2024-09-12T21:51:42.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1209999999999999e-06 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913916+0000", 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8291999999999999e-05 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913928+0000", 2024-09-12T21:51:42.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2455e-05 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913936+0000", 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2290000000000003e-06 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.913988+0000", 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1823999999999997e-05 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.914122+0000", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134017 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.914261+0000", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000138973 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.917400+0000", 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031391610000000001 2024-09-12T21:51:42.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919279+0000", 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018783949999999999 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919329+0000", 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9891000000000001e-05 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:42.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919404+0000", 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5164000000000001e-05 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111787 5.7 5:e5510fbe:::benchmark_data_smithi053_32461_object111786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.903860+0000", 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.015273824, 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.015627566999999998, 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111787 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903860+0000", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903860+0000", 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903861+0000", 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2399999999999997e-07 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903937+0000", 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6464999999999994e-05 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903948+0000", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0556e-05 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.903956+0000", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2879999999999993e-06 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.914053+0000", 2024-09-12T21:51:42.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010097326 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.914159+0000", 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000106224 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.914285+0000", 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012560300000000001 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111810 5.f 5.c725218f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.915136+0000", 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0039980759999999997, 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044098770000000004, 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111810 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915136+0000", 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915136+0000", 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915137+0000", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1100000000000004e-07 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915206+0000", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9671000000000004e-05 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915218+0000", 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1388e-05 2024-09-12T21:51:42.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.915224+0000", 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8580000000000002e-06 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111814 5.1 5:8dc35428:::benchmark_data_smithi053_32461_object111813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.916216+0000", 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002917836, 2024-09-12T21:51:42.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003373961, 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111814 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916216+0000", 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916216+0000", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916217+0000", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4600000000000003e-07 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916276+0000", 2024-09-12T21:51:42.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9242e-05 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916285+0000", 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6899999999999998e-06 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916292+0000", 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4780000000000002e-06 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916346+0000", 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3868e-05 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916482+0000", 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013566899999999999 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.916655+0000", 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017351500000000001 2024-09-12T21:51:42.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918933+0000", 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00227809 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:111818 5.a e43/36 5:529414ae:::benchmark_data_smithi053_32461_object111817:head v 43'6856, mlcod=43'6854)", 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.918567+0000", 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00056647800000000003, 2024-09-12T21:51:42.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010796429999999999, 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918567+0000", 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918567+0000", 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918568+0000", 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918628+0000", 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9783e-05 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918636+0000", 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9410000000000007e-06 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918640+0000", 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5369999999999999e-06 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918687+0000", 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7074999999999999e-05 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918706+0000", 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8703e-05 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111819 5.7 5.6d225a07 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.918758+0000", 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00037560099999999998, 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00091840400000000005, 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111819 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918758+0000", 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918758+0000", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918759+0000", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3099999999999997e-07 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918820+0000", 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0985e-05 2024-09-12T21:51:42.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918827+0000", 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1890000000000001e-06 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.918831+0000", 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9609999999999999e-06 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:111821 5.6 5:696b644c:::benchmark_data_smithi053_32461_object111820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:42.919480+0000", 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9996538, 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000231964, 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 111821 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919480+0000", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919480+0000", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919481+0000", 2024-09-12T21:51:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919591+0000", 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110257 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919600+0000", 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4039999999999995e-06 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919606+0000", 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3339999999999998e-06 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:42.919646+0000", 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:42.976 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 12 2024-09-12T21:51:42.977 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:42.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:42.979 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-09-12T21:51:42.979 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-09-12T21:51:43.016 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:43.014+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:43.080 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-09-12T21:51:43.080 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-09-12T21:51:43.118 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.116+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.167 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:43.167 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:43.168 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:43.168 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:43.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:43.219 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.218+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.320 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.318+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 44 16 112867 112851 160.285 145.812 0.00604822 0.00623626 2024-09-12T21:51:43.367 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:43.367 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.032206857999999, 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:43.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.031934289999999, 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:43.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:43.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:43.382 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.031876364999999, 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:43.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:43.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:43.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.030804396000001, 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:43.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:43.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:43.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.027255815, 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:43.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.025938661000001, 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:43.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:43.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:43.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.025584586000001, 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.408 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:43.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.412 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.024976756000001, 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:43.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.024957314000002, 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:43.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:43.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 31.024250820999999, 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:43.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.218536899, 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.426 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:43.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:43.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.054730722999999, 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.432 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:43.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:43.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.053109328000001, 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:43.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:43.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.053019298999999, 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:43.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:43.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.049847597999999, 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:43.450 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:43.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:43.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.456 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.049327343000002, 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:43.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:43.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:43.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.462 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.042743857000001, 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:43.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:43.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.030134045, 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:43.469 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:43.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:43.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:43.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:43.475 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.352198153, 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:43.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:43.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:43.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 12.351879711, 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:43.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:43.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:43.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:43.487 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:43.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:43.489 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.486+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.589 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.588+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.645 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113517 5.a 5:53c5d810:::benchmark_data_smithi053_32461_object113516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.635899+0000", 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.007264146, 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072905540000000003, 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113517 2024-09-12T21:51:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.635899+0000", 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.635899+0000", 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.635899+0000", 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6300000000000005e-07 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.636012+0000", 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112779 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.636019+0000", 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2599999999999999e-06 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.636025+0000", 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4600000000000002e-06 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.637371+0000", 2024-09-12T21:51:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013458599999999999 2024-09-12T21:51:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.637496+0000", 2024-09-12T21:51:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125167 2024-09-12T21:51:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.637644+0000", 2024-09-12T21:51:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148634 2024-09-12T21:51:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642029+0000", 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043849509999999998 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113526 5.a 5:5dbf65d1:::benchmark_data_smithi053_32461_object113525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.638529+0000", 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046339739999999999, 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047427900000000002, 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113526 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638529+0000", 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638529+0000", 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638530+0000", 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0550000000000001e-06 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638680+0000", 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014970200000000001 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638692+0000", 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2777e-05 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638701+0000", 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4880000000000007e-06 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639534+0000", 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083287200000000002 2024-09-12T21:51:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639675+0000", 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141089 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639838+0000", 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016360100000000001 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642071+0000", 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022331 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113527 5.c 5:3c30760d:::benchmark_data_smithi053_32461_object113526:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.638723+0000", 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044393059999999996, 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046221580000000003, 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113527 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638723+0000", 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638723+0000", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638724+0000", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5799999999999998e-07 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638757+0000", 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2843999999999999e-05 2024-09-12T21:51:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638766+0000", 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9749999999999996e-06 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638772+0000", 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1920000000000002e-06 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638816+0000", 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3755999999999999e-05 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638940+0000", 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426399999999999 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639074+0000", 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133447 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643136+0000", 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040623100000000004 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113528 5.c 5:31047e78:::benchmark_data_smithi053_32461_object113527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.638785+0000", 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043782200000000004, 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046341769999999997, 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113528 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638785+0000", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638785+0000", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638785+0000", 2024-09-12T21:51:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5300000000000004e-07 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638812+0000", 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6625e-05 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638820+0000", 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1170000000000004e-06 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638825+0000", 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5029999999999997e-06 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641192+0000", 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002366688 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641313+0000", 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120599 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641448+0000", 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001349 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:113525 5.6 e43/36 5:65c53659:::benchmark_data_smithi053_32461_object113524:head v 43'7122, mlcod=43'7120)", 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.638976+0000", 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041866619999999998, 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004506375, 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638976+0000", 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638976+0000", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.638977+0000", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000004e-07 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639031+0000", 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4098999999999998e-05 2024-09-12T21:51:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639040+0000", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3039999999999994e-06 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639048+0000", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6190000000000002e-06 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639101+0000", 2024-09-12T21:51:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2756000000000001e-05 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.639165+0000", 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4661999999999999e-05 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113530 5.5 5:a016c79d:::benchmark_data_smithi053_32461_object113529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.640459+0000", 2024-09-12T21:51:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002703544, 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030930720000000001, 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113530 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640459+0000", 2024-09-12T21:51:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640459+0000", 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640460+0000", 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0499999999999999e-06 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640563+0000", 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102954 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640572+0000", 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2830000000000007e-06 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640580+0000", 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0650000000000001e-06 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640635+0000", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5143999999999999e-05 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640783+0000", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014878299999999999 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640929+0000", 2024-09-12T21:51:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014515599999999999 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113531 5.a 5:510159b6:::benchmark_data_smithi053_32461_object113530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.640694+0000", 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024689909999999998, 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002943378, 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113531 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640694+0000", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640694+0000", 2024-09-12T21:51:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640790+0000", 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6630000000000001e-05 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640887+0000", 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6774999999999994e-05 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640897+0000", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5100000000000004e-06 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.640905+0000", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.943e-06 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642099+0000", 2024-09-12T21:51:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001194002 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642213+0000", 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113927 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642375+0000", 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016226399999999999 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113535 5.3 5:cfee0025:::benchmark_data_smithi053_32461_object113534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.641581+0000", 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015821990000000001, 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021263950000000001, 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113535 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641581+0000", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641581+0000", 2024-09-12T21:51:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641581+0000", 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7499999999999999e-07 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641620+0000", 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8519999999999997e-05 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641630+0000", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0163000000000001e-05 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641636+0000", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5770000000000001e-06 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641686+0000", 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0757999999999998e-05 2024-09-12T21:51:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641808+0000", 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121642 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641943+0000", 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135229 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113536 5.c 5:31dda559:::benchmark_data_smithi053_32461_object113535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.641654+0000", 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015086349999999999, 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021196380000000001, 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113536 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641654+0000", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641654+0000", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641655+0000", 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2200000000000004e-07 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641685+0000", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0080999999999999e-05 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641692+0000", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9229999999999996e-06 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641697+0000", 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8849999999999998e-06 2024-09-12T21:51:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643166+0000", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001469817 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643287+0000", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012077 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643432+0000", 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145277 2024-09-12T21:51:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113537 5.3 5:c3af9a70:::benchmark_data_smithi053_32461_object113536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.641710+0000", 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001453202, 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021388230000000002, 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113537 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641710+0000", 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641710+0000", 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641710+0000", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1600000000000001e-07 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641739+0000", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8481999999999999e-05 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641745+0000", 2024-09-12T21:51:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8109999999999997e-06 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641750+0000", 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0660000000000003e-06 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643614+0000", 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018640530000000001 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643711+0000", 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6848000000000005e-05 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.643812+0000", 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100252 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113538 5.e 5:79c18690:::benchmark_data_smithi053_32461_object113537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.641783+0000", 2024-09-12T21:51:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013792380000000001, 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021372510000000002, 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113538 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641783+0000", 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641783+0000", 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641784+0000", 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641866+0000", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1736000000000005e-05 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641873+0000", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0949999999999998e-06 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641878+0000", 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0100000000000003e-06 2024-09-12T21:51:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.641926+0000", 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8467000000000002e-05 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.642056+0000", 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012924799999999999 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:51:43.704 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:43.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:43.706 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.703+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.806 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.804+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:43.860 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:43.860 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:43.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:43.907 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:43.906+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:44.008 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:44.006+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.693345471000001, 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.692023944999999, 2024-09-12T21:51:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.691536102000001, 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.690808721, 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.685014164000002, 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.723964670000001, 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.723837210999999, 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.723778590999999, 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.721666944999999, 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.720010002999999, 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.719060404, 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.714836317, 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.712482778999998, 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.710859587000002, 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.420931109, 2024-09-12T21:51:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.420644812000001, 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:94042 5.a 5:584ed8f9:::benchmark_data_smithi053_32461_object94041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.854309808, 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023272444, 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 94042 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178761+0000", 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178762+0000", 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-06 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178860+0000", 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7714999999999995e-05 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178869+0000", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1130000000000007e-06 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.178876+0000", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1860000000000003e-06 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.191868+0000", 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012991310000000001 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192000+0000", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132006 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.192323+0000", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032316400000000003 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.194616+0000", 2024-09-12T21:51:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002293729 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201885+0000", 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072681000000000004 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.201941+0000", 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6323000000000003e-05 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:35.202034+0000", 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2682000000000005e-05 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.942164988, 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105346 5.a 5:540ff5c7:::benchmark_data_smithi053_32461_object105345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.944027755, 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023934706, 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105346 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089044+0000", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089224+0000", 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179636 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089233+0000", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3689999999999996e-06 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089240+0000", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097718+0000", 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084781890000000006 2024-09-12T21:51:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097868+0000", 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015013200000000001 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.098063+0000", 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194802 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110498+0000", 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435827 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112830+0000", 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023316470000000001 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112891+0000", 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0609000000000002e-05 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112978+0000", 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7162000000000003e-05 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113761 5.a 5:5abfd87c:::benchmark_data_smithi053_32461_object113760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.29615559600000002, 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023971421, 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113761 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736916+0000", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736946+0000", 2024-09-12T21:51:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0343000000000001e-05 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736955+0000", 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2549999999999997e-06 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736960+0000", 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7660000000000004e-06 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747370+0000", 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010409725999999999 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747555+0000", 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000184604 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747720+0000", 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016520400000000001 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.755325+0000", 2024-09-12T21:51:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076054080000000001 2024-09-12T21:51:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760726+0000", 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054010550000000001 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760784+0000", 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7583000000000001e-05 2024-09-12T21:51:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760887+0000", 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010287499999999999 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.157 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:44.159 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.156+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:44.260 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:44.258+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:115020 5.5 e43/21 5:a18e08ae:::benchmark_data_smithi053_32461_object115019:head v 43'7196, mlcod=43'7191)", 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:44.295078+0000", 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0032681640000000001, 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032867719999999999, 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:44.299 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295078+0000", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295078+0000", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295079+0000", 2024-09-12T21:51:44.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9500000000000001e-07 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295136+0000", 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7515000000000001e-05 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295146+0000", 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0148e-05 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295153+0000", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1860000000000003e-06 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.296224+0000", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010707799999999999 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.296243+0000", 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8802000000000001e-05 2024-09-12T21:51:44.302 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:115027 5.1 5:820c78e6:::benchmark_data_smithi053_32461_object115026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:44.295516+0000", 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028300619999999999, 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029124899999999998, 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 115027 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295516+0000", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295516+0000", 2024-09-12T21:51:44.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295517+0000", 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.032e-06 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295578+0000", 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1446999999999996e-05 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295588+0000", 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8109999999999997e-06 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295596+0000", 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3390000000000004e-06 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295645+0000", 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9208e-05 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295774+0000", 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012937100000000001 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295953+0000", 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000178612 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:115028 5.1 5:8d134142:::benchmark_data_smithi053_32461_object115027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:44.295832+0000", 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025136410000000001, 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026718039999999998, 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 115028 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.308 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295832+0000", 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295832+0000", 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295833+0000", 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0999999999999997e-07 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295896+0000", 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2619999999999993e-05 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295907+0000", 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1617000000000001e-05 2024-09-12T21:51:44.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.295915+0000", 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.746e-06 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297829+0000", 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019134149999999999 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297961+0000", 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013192600000000001 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.298101+0000", 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014009999999999999 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:115023 5.5 e43/21 5:ac444827:::benchmark_data_smithi053_32461_object115022:head v 43'7197, mlcod=43'7191)", 2024-09-12T21:51:44.312 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:44.297828+0000", 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00051838899999999996, 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00074211299999999997, 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297828+0000", 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297828+0000", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297828+0000", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9599999999999998e-07 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297883+0000", 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4487999999999997e-05 2024-09-12T21:51:44.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297902+0000", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9400999999999999e-05 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297922+0000", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9607999999999999e-05 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.297973+0000", 2024-09-12T21:51:44.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1520999999999997e-05 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:44.298005+0000", 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1600000000000002e-05 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 4 2024-09-12T21:51:44.316 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:44.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:44.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 45 16 115176 115160 159.93 144.312 0.00364586 0.00625006 2024-09-12T21:51:44.361 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.358+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:51:44.462 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.460+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.509 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:44.509 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:44.509 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:44.509 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:44.509 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:44.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:44.563 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.561+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.664 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:44.662+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.332884550999999, 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:44.668 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:44.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.674 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.332611983, 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:44.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.332554057999999, 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:44.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.331482088999998, 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.687 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:44.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.327933508000001, 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:44.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:44.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.326616354000002, 2024-09-12T21:51:44.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:44.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.326262278999998, 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:44.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:44.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:44.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.325654448999998, 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:44.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.325635007000002, 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:44.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:44.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.324928514, 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:44.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:44.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:44.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.519214592000001, 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.722 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:44.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:44.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.355408416, 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:44.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:44.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.353787020999999, 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:44.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:44.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.353696992, 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:44.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:44.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:44.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.350525291, 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:44.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.753 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.350005035999999, 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:44.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:44.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.759 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.343421549999999, 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:44.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:44.765 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 23.330811738000001, 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:44.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:44.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:44.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.652875846000001, 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.774 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:44.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.652557404, 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:44.780 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:44.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:44.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:44.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:44.786 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:44.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:44.788 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.785+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:44.888 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:44.886+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:44.941 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116514 5.4 5:246ffd87:::benchmark_data_smithi053_32461_object116513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.938303+0000", 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021289080000000001, 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00215585, 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116514 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938303+0000", 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938303+0000", 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938304+0000", 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0270000000000001e-06 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938331+0000", 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7569e-05 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938343+0000", 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1474999999999999e-05 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938351+0000", 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0709999999999995e-06 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939274+0000", 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092347299999999996 2024-09-12T21:51:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939399+0000", 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012438299999999999 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116516 5.4 5.da7dbbf4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.938648+0000", 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017838350000000001, 2024-09-12T21:51:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018790720000000001, 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116516 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938648+0000", 2024-09-12T21:51:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938648+0000", 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938649+0000", 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5199999999999995e-07 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938764+0000", 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115642 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938775+0000", 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938781+0000", 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1700000000000002e-06 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:116512 5.6 e43/36 5:6d998dbd:::benchmark_data_smithi053_32461_object116511:head v 43'7311, mlcod=43'7307)", 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.938898+0000", 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015336130000000001, 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00168815, 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938898+0000", 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938898+0000", 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938898+0000", 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2900000000000004e-07 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939039+0000", 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014028099999999999 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939047+0000", 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5250000000000005e-06 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939053+0000", 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2099999999999998e-06 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940145+0000", 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001091355 2024-09-12T21:51:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940163+0000", 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8355999999999998e-05 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116519 5.4 5.7ed5fdb4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.939877+0000", 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000554019, 2024-09-12T21:51:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00076649499999999996, 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116519 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939877+0000", 2024-09-12T21:51:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939877+0000", 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.939878+0000", 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2799999999999995e-07 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940029+0000", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150533 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940040+0000", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0908e-05 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940047+0000", 2024-09-12T21:51:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4120000000000004e-06 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116520 5.c 5.9a76519c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.940066+0000", 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000365404, 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062045799999999995, 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116520 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940066+0000", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940066+0000", 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940067+0000", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6899999999999996e-07 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940160+0000", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3238000000000004e-05 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940170+0000", 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0054000000000001e-05 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940177+0000", 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9110000000000004e-06 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116521 5.b 5:d58dc06e:::benchmark_data_smithi053_32461_object116520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.940304+0000", 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000127205, 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041460599999999998, 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116521 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940304+0000", 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940304+0000", 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940305+0000", 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1900000000000001e-07 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940370+0000", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4445999999999999e-05 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940378+0000", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1119999999999996e-06 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940382+0000", 2024-09-12T21:51:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5870000000000003e-06 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940556+0000", 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017317600000000001 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940670+0000", 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116522 5.e 5:7aa4fd11:::benchmark_data_smithi053_32461_object116521:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.940396+0000", 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5221e-05, 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035790399999999998, 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116522 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940396+0000", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940396+0000", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940397+0000", 2024-09-12T21:51:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7299999999999996e-07 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940471+0000", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4040000000000003e-05 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940477+0000", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8109999999999999e-06 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940480+0000", 2024-09-12T21:51:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6890000000000002e-06 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940520+0000", 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9762999999999999e-05 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.940630+0000", 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011025499999999999 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116505 5.c 5:33164983:::benchmark_data_smithi053_32461_object116504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.934794+0000", 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056373109999999999, 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059977529999999998, 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116505 2024-09-12T21:51:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934794+0000", 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934794+0000", 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934795+0000", 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.023e-06 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934831+0000", 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5667999999999998e-05 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934844+0000", 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3346999999999999e-05 2024-09-12T21:51:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934853+0000", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4030000000000007e-06 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.934912+0000", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9398999999999998e-05 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.935029+0000", 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117386 2024-09-12T21:51:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.935157+0000", 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012732800000000001 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937474+0000", 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023170119999999998 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116509 5.4 5:2242fdf4:::benchmark_data_smithi053_32461_object116508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.937042+0000", 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033891170000000001, 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038270470000000001, 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116509 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937042+0000", 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937042+0000", 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937043+0000", 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3300000000000001e-07 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937071+0000", 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7983999999999998e-05 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937080+0000", 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8929999999999994e-06 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937087+0000", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7549999999999997e-06 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937145+0000", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8059000000000001e-05 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937266+0000", 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120909 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:116506 5.6 e43/36 5:65c18c6a:::benchmark_data_smithi053_32461_object116505:head v 43'7310, mlcod=43'7306)", 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.937161+0000", 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032703179999999999, 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003769625, 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937161+0000", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937161+0000", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937162+0000", 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9799999999999999e-07 2024-09-12T21:51:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937190+0000", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8297999999999999e-05 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937197+0000", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9739999999999996e-06 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937202+0000", 2024-09-12T21:51:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937487+0000", 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028499200000000003 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937506+0000", 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8539999999999999e-05 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:116513 5.b 5:d01aabb6:::benchmark_data_smithi053_32461_object116512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:44.937340+0000", 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030912410000000002, 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036238080000000001, 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116513 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937340+0000", 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937340+0000", 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937341+0000", 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9999999999999997e-07 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937366+0000", 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5196999999999999e-05 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937374+0000", 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8690000000000004e-06 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.937380+0000", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8719999999999999e-06 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938470+0000", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001090485 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:44.938606+0000", 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586100000000001 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:44.987 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:44.988 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:44.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:44.990 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:44.988+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:44.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:45.000 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:45.000 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:45.090 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.089+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.183 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:45.183 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:45.191 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.190+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:45.292 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:45.291+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:45.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 46 16 117461 117445 159.557 142.812 0.00778386 0.00626473 2024-09-12T21:51:45.365 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:45.408 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.407+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.457 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:51:45.494 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.493+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.508 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:45.509 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:45.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:45.594 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:45.594+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:45.695 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.693+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.707 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:45.707 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:45.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:45.804 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.803+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:45.897 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:45.896+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:45.902 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:45.903 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:45.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:45.998 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:45.997+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:46.071 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.071 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:46.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:46.128 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:46.127+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:46.201 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:46.200+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:46.234 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.234 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:46.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:46.301 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:46.300+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:46.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 47 16 119733 119717 159.184 142 0.00648555 0.00627964 2024-09-12T21:51:46.403 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:46.402+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:46.442 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.442 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:46.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:46.504 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:46.502+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:46.600 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.600 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:46.605 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:46.604+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:46.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:46.705 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:46.704+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:46.794 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.794 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:46.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:46.807 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:46.806+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:46.907 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:46.906+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:46.992 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:46.992 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:47.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:47.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:47.048 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.046+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.109 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.107+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.129 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:47.130 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:47.149 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:47.153 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:47.153 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121510 5.8 5:1241138e:::benchmark_data_smithi053_32461_object121509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.150279+0000", 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079725179999999996, 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079999300000000006, 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121510 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150279+0000", 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150279+0000", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150279+0000", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3099999999999998e-07 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150302+0000", 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2952e-05 2024-09-12T21:51:47.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150309+0000", 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0280000000000003e-06 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.150315+0000", 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7060000000000001e-06 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152272+0000", 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019571240000000002 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152429+0000", 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015724099999999999 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121516 5.0 5:007d2ef6:::benchmark_data_smithi053_32461_object121515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.152180+0000", 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0060715090000000001, 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061715379999999999, 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121516 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152180+0000", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152180+0000", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152181+0000", 2024-09-12T21:51:47.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4799999999999997e-07 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152251+0000", 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0123999999999995e-05 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152260+0000", 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3579999999999992e-06 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.152268+0000", 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9610000000000005e-06 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154353+0000", 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020846060000000001 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154474+0000", 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012070600000000001 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121519 5.3 5:c0d72b60:::benchmark_data_smithi053_32461_object121518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.153951+0000", 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043001719999999997, 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044618749999999997, 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121519 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.153951+0000", 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.153951+0000", 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.153953+0000", 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3370000000000001e-06 2024-09-12T21:51:47.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154010+0000", 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7070000000000001e-05 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154019+0000", 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154024+0000", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0139999999999998e-06 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154509+0000", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048520099999999999 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154653+0000", 2024-09-12T21:51:47.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014362500000000001 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154816+0000", 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016366300000000001 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156730+0000", 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001913405 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121520 5.0 5:0a7eb95e:::benchmark_data_smithi053_32461_object121519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.154511+0000", 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037405889999999999, 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039746299999999998, 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121520 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154511+0000", 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154511+0000", 2024-09-12T21:51:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154511+0000", 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9400000000000005e-07 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154563+0000", 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1563000000000001e-05 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154570+0000", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9149999999999999e-06 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.154574+0000", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0319999999999997e-06 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156307+0000", 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017334729999999999 2024-09-12T21:51:47.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156427+0000", 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119962 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121524 5.4 5:258b9cc9:::benchmark_data_smithi053_32461_object121523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.155524+0000", 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027272770000000002, 2024-09-12T21:51:47.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030212860000000002, 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121524 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155524+0000", 2024-09-12T21:51:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155524+0000", 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155525+0000", 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3e-07 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155629+0000", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104616 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155640+0000", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0329999999999999e-05 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155647+0000", 2024-09-12T21:51:47.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4290000000000004e-06 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155752+0000", 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105198 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155866+0000", 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113995 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121525 5.b 5:da120396:::benchmark_data_smithi053_32461_object121524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.155686+0000", 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025655560000000001, 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029187810000000001, 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121525 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155686+0000", 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155686+0000", 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155687+0000", 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155740+0000", 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3647000000000003e-05 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155749+0000", 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5399999999999996e-06 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155755+0000", 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0499999999999997e-06 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156761+0000", 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010064130000000001 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156897+0000", 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136267 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121526 5.0 5.a7caaff0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.155790+0000", 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024616320000000001, 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028705929999999998, 2024-09-12T21:51:47.188 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121526 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155790+0000", 2024-09-12T21:51:47.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155790+0000", 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155790+0000", 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155867+0000", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6328000000000005e-05 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155875+0000", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.824e-06 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155880+0000", 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7250000000000002e-06 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121527 5.b 5.e185578b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.155895+0000", 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023562499999999998, 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028133329999999999, 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121527 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155895+0000", 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155895+0000", 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155896+0000", 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155953+0000", 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7160000000000002e-05 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155961+0000", 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6979999999999998e-06 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.155966+0000", 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121529 5.b 5.d209b95b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.156467+0000", 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017839900000000001, 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022870249999999998, 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121529 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156467+0000", 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156467+0000", 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156468+0000", 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9400000000000004e-07 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156547+0000", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8777999999999997e-05 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156556+0000", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0010000000000007e-06 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156563+0000", 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6640000000000001e-06 2024-09-12T21:51:47.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121530 5.8 5:165c82f2:::benchmark_data_smithi053_32461_object121529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.156815+0000", 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00143654, 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019970109999999999, 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121530 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156815+0000", 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156815+0000", 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156816+0000", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156911+0000", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4988000000000006e-05 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156921+0000", 2024-09-12T21:51:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007e-05 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.156928+0000", 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1740000000000003e-06 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.158161+0000", 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001233194 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.158243+0000", 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2071999999999996e-05 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:121523 5.7 e44/21 5:e8e5a742:::benchmark_data_smithi053_32461_object121522:head v 44'7635, mlcod=44'7633)", 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.157127+0000", 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001124021, 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001753912, 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157127+0000", 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157127+0000", 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157128+0000", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999998e-07 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157250+0000", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012233599999999999 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157257+0000", 2024-09-12T21:51:47.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9310000000000002e-06 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157261+0000", 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.33e-06 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157305+0000", 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4084e-05 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157323+0000", 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7923000000000001e-05 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121532 5.b 5.35537b7b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.157153+0000", 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00109869, 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017841580000000001, 2024-09-12T21:51:47.207 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121532 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157153+0000", 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157153+0000", 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157153+0000", 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6600000000000002e-07 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157284+0000", 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013096900000000001 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157291+0000", 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7920000000000004e-06 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157296+0000", 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7450000000000003e-06 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:121531 5.1 e44/36 5:8ec3ee9c:::benchmark_data_smithi053_32461_object121530:head v 44'7564, mlcod=44'7562)", 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.157402+0000", 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00084923599999999996, 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015877210000000001, 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157402+0000", 2024-09-12T21:51:47.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157402+0000", 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157402+0000", 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2000000000000001e-07 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157470+0000", 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7182999999999997e-05 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157475+0000", 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6790000000000002e-06 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157478+0000", 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1200000000000002e-06 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157524+0000", 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5992000000000003e-05 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.157547+0000", 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2819999999999998e-05 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-09-12T21:51:47.215 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:47.216 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.214+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:47.317 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:47.316+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:47.358 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 48 16 121983 121967 158.797 140.625 0.00280565 0.00629468 2024-09-12T21:51:47.370 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:47.370 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:47.371 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:47.371 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:47.371 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:47.383 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:47.417 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.416+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:51:47.520 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:47.518+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:47.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.239501036, 2024-09-12T21:51:47.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:47.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:47.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:47.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.238179510000002, 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:47.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:47.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.237691667, 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:47.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:47.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.236964286000003, 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:47.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:47.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:47.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.231169729000001, 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:47.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.270120235, 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:47.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:47.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.269992775999999, 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:47.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.269934156000001, 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:47.625 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:47.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.267822509999998, 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:47.632 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:47.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:47.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.638 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.266165568000002, 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:47.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:47.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:47.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.265215969, 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:47.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:47.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.260991881999999, 2024-09-12T21:51:47.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:47.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:47.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:47.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.258638344000001, 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:47.658 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:47.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.257015152000001, 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:47.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:47.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85842 5.b 5:d105ce3b:::benchmark_data_smithi053_32461_object85841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.967086674000001, 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023491036, 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85842 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612140+0000", 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612141+0000", 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612192+0000", 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1372999999999998e-05 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612199+0000", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3660000000000003e-06 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612206+0000", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624628+0000", 2024-09-12T21:51:47.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012422434 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624743+0000", 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115098 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635474+0000", 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01073034 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635528+0000", 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4333000000000003e-05 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635631+0000", 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102855 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:85843 5.3 5:c4fd47ef:::benchmark_data_smithi053_32461_object85842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.966800377, 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023336625999999999, 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 85843 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612426+0000", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612427+0000", 2024-09-12T21:51:47.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612486+0000", 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8718999999999998e-05 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612497+0000", 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0939e-05 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.612503+0000", 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624704+0000", 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012200865999999999 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624818+0000", 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114603 2024-09-12T21:51:47.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.624946+0000", 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012769100000000001 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.631223+0000", 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062770940000000004 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635640+0000", 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044172270000000001 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635693+0000", 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2884999999999999e-05 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:31.635763+0000", 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9598999999999996e-05 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4883205529999994, 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:47.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:47.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105346 5.a 5:540ff5c7:::benchmark_data_smithi053_32461_object105345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4901833199999999, 2024-09-12T21:51:47.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023934706, 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105346 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089044+0000", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089224+0000", 2024-09-12T21:51:47.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179636 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089233+0000", 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3689999999999996e-06 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089240+0000", 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097718+0000", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084781890000000006 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097868+0000", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015013200000000001 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.098063+0000", 2024-09-12T21:51:47.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194802 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110498+0000", 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435827 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112830+0000", 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023316470000000001 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112891+0000", 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0609000000000002e-05 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112978+0000", 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7162000000000003e-05 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113761 5.a 5:5abfd87c:::benchmark_data_smithi053_32461_object113760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.842311161, 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023971421, 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113761 2024-09-12T21:51:47.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736916+0000", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736946+0000", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0343000000000001e-05 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736955+0000", 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2549999999999997e-06 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736960+0000", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7660000000000004e-06 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747370+0000", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010409725999999999 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747555+0000", 2024-09-12T21:51:47.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000184604 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747720+0000", 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016520400000000001 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.755325+0000", 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076054080000000001 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760726+0000", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054010550000000001 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760784+0000", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7583000000000001e-05 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760887+0000", 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010287499999999999 2024-09-12T21:51:47.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.36371421999999998, 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:47.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:47.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:51:47.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:51:47.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:47.707 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:47.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:47.710 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.707+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.810 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:47.808+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:123064 5.a e44/36 5:5878ffd6:::benchmark_data_smithi053_32461_object123063:head v 44'7509, mlcod=44'7507)", 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.842875+0000", 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0090950670000000001, 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091214750000000004, 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842875+0000", 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842875+0000", 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842875+0000", 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5999999999999999e-07 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842950+0000", 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4523999999999993e-05 2024-09-12T21:51:47.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842957+0000", 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5349999999999999e-06 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.842963+0000", 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2700000000000004e-06 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843095+0000", 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013211000000000001 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843112+0000", 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7455000000000001e-05 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123068 5.6 5:64392430:::benchmark_data_smithi053_32461_object123067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.843655+0000", 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0083152810000000008, 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0084137489999999999, 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123068 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.859 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843655+0000", 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843655+0000", 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843656+0000", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.066e-06 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843733+0000", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7589999999999994e-05 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843743+0000", 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4520000000000003e-06 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.843749+0000", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3729999999999998e-06 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.844498+0000", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00074887700000000001 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.844616+0000", 2024-09-12T21:51:47.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117602 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.844750+0000", 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013438400000000001 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849658+0000", 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049077060000000004 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.863 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123073 5.7 5:e1e317f3:::benchmark_data_smithi053_32461_object123072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.845770+0000", 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0061995599999999998, 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063835180000000004, 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123073 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845770+0000", 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845770+0000", 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845771+0000", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0100000000000004e-07 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845828+0000", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6910000000000002e-05 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845836+0000", 2024-09-12T21:51:47.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4429999999999997e-06 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845840+0000", 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0049999999999998e-06 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845868+0000", 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.811e-05 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845968+0000", 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9906000000000002e-05 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846085+0000", 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117247 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.868 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:123071 5.3 e44/21 5:cc35d774:::benchmark_data_smithi053_32461_object123070:head v 44'7820, mlcod=44'7817)", 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.845872+0000", 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0060977979999999998, 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0063544930000000001, 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845872+0000", 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845872+0000", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845873+0000", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6699999999999999e-07 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845938+0000", 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5228000000000006e-05 2024-09-12T21:51:47.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845945+0000", 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.413e-06 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.845953+0000", 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5469999999999999e-06 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846001+0000", 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8503e-05 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846024+0000", 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2560000000000001e-05 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123074 5.6 5:6365f200:::benchmark_data_smithi053_32461_object123073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.872 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.846677+0000", 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0052929400000000003, 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0056130440000000002, 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123074 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846677+0000", 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846677+0000", 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846678+0000", 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0500000000000002e-07 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846734+0000", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6258999999999998e-05 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846743+0000", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3470000000000005e-06 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846750+0000", 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9809999999999997e-06 2024-09-12T21:51:47.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846791+0000", 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0797999999999998e-05 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.846907+0000", 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011574900000000001 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847038+0000", 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131135 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:123070 5.a e44/36 5:5c3ab269:::benchmark_data_smithi053_32461_object123069:head v 44'7510, mlcod=44'7507)", 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.847323+0000", 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0046469340000000001, 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051268449999999997, 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.877 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847323+0000", 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847323+0000", 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847323+0000", 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4200000000000002e-07 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847327+0000", 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3900000000000002e-06 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847333+0000", 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0070000000000003e-06 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.847336+0000", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4309999999999998e-06 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849350+0000", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002013496 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849369+0000", 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9502000000000001e-05 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.880 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123077 5.7 5:ee3cef61:::benchmark_data_smithi053_32461_object123076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.848752+0000", 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.003217892, 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037540059999999998, 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.881 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123077 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848752+0000", 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848752+0000", 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848753+0000", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2799999999999995e-07 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848778+0000", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4879e-05 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848789+0000", 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0909e-05 2024-09-12T21:51:47.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.848794+0000", 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2660000000000001e-06 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849621+0000", 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00082718600000000005 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849698+0000", 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6685000000000002e-05 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849786+0000", 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7904000000000004e-05 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:123075 5.a e44/36 5:5e5636b1:::benchmark_data_smithi053_32461_object123074:head v 44'7511, mlcod=44'7507)", 2024-09-12T21:51:47.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.849553+0000", 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0024168409999999999, 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030180960000000001, 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849553+0000", 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849553+0000", 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849554+0000", 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4099999999999999e-07 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849558+0000", 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849566+0000", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8300000000000002e-06 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849572+0000", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9989999999999997e-06 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851063+0000", 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001490508 2024-09-12T21:51:47.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851081+0000", 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8249000000000001e-05 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123078 5.6 5:662fdb53:::benchmark_data_smithi053_32461_object123077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.849774+0000", 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021958350000000001, 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028515200000000002, 2024-09-12T21:51:47.889 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123078 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849774+0000", 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849774+0000", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849775+0000", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8999999999999995e-07 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849861+0000", 2024-09-12T21:51:47.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6130000000000004e-05 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849870+0000", 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1749999999999994e-06 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849878+0000", 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1130000000000001e-06 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849923+0000", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4947999999999997e-05 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850051+0000", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012820900000000001 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850195+0000", 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014310399999999999 2024-09-12T21:51:47.893 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123079 5.7 5:e8df0592:::benchmark_data_smithi053_32461_object123078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.849894+0000", 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002076399, 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027971810000000001, 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.894 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123079 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849894+0000", 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849894+0000", 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849894+0000", 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3499999999999996e-07 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849966+0000", 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2285000000000003e-05 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849974+0000", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0139999999999998e-06 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849980+0000", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851975+0000", 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019954360000000002 2024-09-12T21:51:47.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852098+0000", 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012297 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852238+0000", 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014030800000000001 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123083 5.6 5:65ba8e8f:::benchmark_data_smithi053_32461_object123082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.849990+0000", 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019796570000000001, 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027653259999999998, 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123083 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849990+0000", 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849990+0000", 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.849991+0000", 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7800000000000002e-07 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850098+0000", 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000106805 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850105+0000", 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7249999999999997e-06 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850111+0000", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.237e-06 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851945+0000", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001834657 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852088+0000", 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014288300000000001 2024-09-12T21:51:47.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852265+0000", 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017683999999999999 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:123081 5.c e44/21 5:37d7d2e3:::benchmark_data_smithi053_32461_object123080:head v 44'7634, mlcod=44'7632)", 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.850301+0000", 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001669453, 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025167190000000002, 2024-09-12T21:51:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850301+0000", 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850301+0000", 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850301+0000", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850379+0000", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7626000000000005e-05 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850388+0000", 2024-09-12T21:51:47.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1530000000000003e-06 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850393+0000", 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850439+0000", 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6427999999999997e-05 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.850458+0000", 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8442000000000001e-05 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123084 5.f 5:f97c16bf:::benchmark_data_smithi053_32461_object123083:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.851548+0000", 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000422089, 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00132354, 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123084 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851548+0000", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851548+0000", 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851549+0000", 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9900000000000009e-07 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851603+0000", 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4203000000000003e-05 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851612+0000", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7239999999999998e-06 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851617+0000", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.955e-06 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.851957+0000", 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00034020600000000002 2024-09-12T21:51:47.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852085+0000", 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000127988 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:123085 5.9 5.3df908e9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:47.852788+0000", 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9991817, 2024-09-12T21:51:47.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000143523, 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 123085 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852788+0000", 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852788+0000", 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852789+0000", 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7299999999999995e-07 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:47.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852856+0000", 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7390000000000004e-05 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852865+0000", 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1980000000000007e-06 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852870+0000", 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7160000000000002e-06 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:47.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:47.852917+0000", 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7190000000000001e-05 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 14 2024-09-12T21:51:47.915 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:47.916 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:47.915+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:47.917 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:48.017 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.016+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.104 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:48.104 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:48.104 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:48.104 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:48.105 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:48.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:48.118 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.117+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.219 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.217+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.262 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.926918471999997, 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.926645903999997, 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.926587978999997, 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.925516010000003, 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.921967428999999, 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.920650275, 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.920296200000003, 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:48.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:48.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.919688370000003, 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:48.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.315 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.919668928, 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:48.316 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:48.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.918962434999997, 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.321 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:48.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.326 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 27.113248512999998, 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:48.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.333 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.949442337000001, 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.334 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:48.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:48.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:48.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:48.340 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.947820942, 2024-09-12T21:51:48.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:48.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:48.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:48.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.947730913000001, 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:48.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:48.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:48.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.944559212000001, 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:48.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:48.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:48.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.363 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.944038957, 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:48.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:48.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:48.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.937455471, 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:48.371 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:48.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:48.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:48.378 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 26.924845658999999, 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:48.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.246909766999998, 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:48.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:48.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.392 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.246591325000001, 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:48.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:48.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:48.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:48.399 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:48.400 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 49 15 124258 124243 158.459 142.25 0.00580296 0.006308 2024-09-12T21:51:48.400 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.399+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:51:48.500 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.499+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.558 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124671 5.0 5:063526fe:::benchmark_data_smithi053_32461_object124670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.555156+0000", 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001479724, 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015057670000000001, 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124671 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555156+0000", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555156+0000", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555157+0000", 2024-09-12T21:51:48.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1100000000000005e-07 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555224+0000", 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6661000000000004e-05 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555233+0000", 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8990000000000007e-06 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555239+0000", 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8270000000000003e-06 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555287+0000", 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8371000000000002e-05 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555416+0000", 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128629 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:124643 5.2 e45/36)", 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.556100+0000", 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00053629399999999999, 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062965099999999995, 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556100+0000", 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556100+0000", 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556100+0000", 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6100000000000001e-07 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556105+0000", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0980000000000004e-06 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556112+0000", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9000000000000006e-06 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556119+0000", 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.049e-06 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:124668 5.7 e45/21 5:ece8d53f:::benchmark_data_smithi053_32461_object124667:head v 45'7852, mlcod=45'7850)", 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.556130+0000", 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00050620099999999996, 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000645423, 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556130+0000", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556130+0000", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556130+0000", 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7700000000000001e-07 2024-09-12T21:51:48.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556160+0000", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0043e-05 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556167+0000", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3570000000000003e-06 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556171+0000", 2024-09-12T21:51:48.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556217+0000", 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556234+0000", 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7842999999999998e-05 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:124660 5.a e45/36)", 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.556490+0000", 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00014584799999999999, 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034081200000000002, 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556490+0000", 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556490+0000", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556491+0000", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8799999999999998e-07 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556494+0000", 2024-09-12T21:51:48.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9490000000000001e-06 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556503+0000", 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9630000000000004e-06 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556508+0000", 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7100000000000004e-06 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:124657 5.2 e45/36)", 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.556518+0000", 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000118292, 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036375099999999999, 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556518+0000", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556518+0000", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556518+0000", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8199999999999999e-07 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556520+0000", 2024-09-12T21:51:48.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9630000000000001e-06 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556527+0000", 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6139999999999997e-06 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556531+0000", 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3900000000000003e-06 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124672 5.8 5.efaa9b08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.556804+0000", 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998322, 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012412799999999999, 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124672 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556804+0000", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556804+0000", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556805+0000", 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1200000000000001e-07 2024-09-12T21:51:48.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556874+0000", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8937999999999996e-05 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556883+0000", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6080000000000002e-06 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556890+0000", 2024-09-12T21:51:48.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6329999999999999e-06 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556936+0000", 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6363000000000003e-05 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124655 5.4 5:2ba941c6:::benchmark_data_smithi053_32461_object124654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.548738+0000", 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078979730000000008, 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082326840000000005, 2024-09-12T21:51:48.580 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124655 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548738+0000", 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548738+0000", 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548739+0000", 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0070000000000001e-06 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548851+0000", 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112111 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548870+0000", 2024-09-12T21:51:48.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8788999999999999e-05 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.548879+0000", 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.456e-06 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550329+0000", 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001450769 2024-09-12T21:51:48.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550470+0000", 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014086099999999999 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556840+0000", 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006369609 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:48.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.556909+0000", 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9370999999999997e-05 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124657 5.2 5:41e7522b:::benchmark_data_smithi053_32461_object124656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.549192+0000", 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0074443069999999998, 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078223770000000001, 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124657 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549192+0000", 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549192+0000", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549193+0000", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2500000000000004e-07 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549214+0000", 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0676999999999999e-05 2024-09-12T21:51:48.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549225+0000", 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549231+0000", 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552163+0000", 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029314580000000001 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552283+0000", 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120588 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552436+0000", 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015238299999999999 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124659 5.4 5:28bd5b20:::benchmark_data_smithi053_32461_object124658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.550013+0000", 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066228900000000002, 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070433400000000004, 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124659 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550013+0000", 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550013+0000", 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550014+0000", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8100000000000001e-07 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550092+0000", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7971000000000003e-05 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550100+0000", 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-09-12T21:51:48.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550108+0000", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.114e-06 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552484+0000", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023765359999999998 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552594+0000", 2024-09-12T21:51:48.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109919 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124660 5.a 5:544ddd07:::benchmark_data_smithi053_32461_object124659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.550877+0000", 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005759709, 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062149299999999996, 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124660 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550877+0000", 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550877+0000", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550877+0000", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7000000000000004e-07 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550955+0000", 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8096000000000006e-05 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550964+0000", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1919999999999994e-06 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550976+0000", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1980999999999999e-05 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552150+0000", 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011734600000000001 2024-09-12T21:51:48.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552291+0000", 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140848 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552479+0000", 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188369 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124664 5.4 5:2af940be:::benchmark_data_smithi053_32461_object124663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.552545+0000", 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040914879999999999, 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045844170000000004, 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124664 2024-09-12T21:51:48.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552545+0000", 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552545+0000", 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552545+0000", 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552570+0000", 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4607999999999999e-05 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552578+0000", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.337e-06 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.552585+0000", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3910000000000003e-06 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554749+0000", 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002164408 2024-09-12T21:51:48.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554888+0000", 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013881599999999999 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124665 5.8 5:1515a7fa:::benchmark_data_smithi053_32461_object124664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.554080+0000", 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002556076, 2024-09-12T21:51:48.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003108951, 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124665 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554080+0000", 2024-09-12T21:51:48.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554080+0000", 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554081+0000", 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0380000000000001e-06 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554108+0000", 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6387999999999999e-05 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554119+0000", 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1331e-05 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554126+0000", 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9290000000000001e-06 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554183+0000", 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6901000000000003e-05 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554345+0000", 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016183300000000001 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124643 5.2 5:480ff597:::benchmark_data_smithi053_32461_object124642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.542569+0000", 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.014066834, 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014685058000000001, 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124643 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542569+0000", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542569+0000", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542570+0000", 2024-09-12T21:51:48.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542639+0000", 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9265999999999997e-05 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542650+0000", 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0668e-05 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.542656+0000", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.549938+0000", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072814150000000003 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550046+0000", 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108152 2024-09-12T21:51:48.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.550192+0000", 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146012 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124667 5.2 5:449022a7:::benchmark_data_smithi053_32461_object124666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.554784+0000", 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001852266, 2024-09-12T21:51:48.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025441180000000002, 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124667 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554784+0000", 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554784+0000", 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554785+0000", 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8000000000000004e-07 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:48.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554854+0000", 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.881e-05 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554868+0000", 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4389000000000001e-05 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.554875+0000", 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8449999999999997e-06 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555015+0000", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555131+0000", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011613800000000001 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.555270+0000", 2024-09-12T21:51:48.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013872 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-09-12T21:51:48.618 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:48.619 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:48.617+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:48.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:48.720 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.719+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:48.816 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:48.816 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:48.816 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:48.816 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:48.816 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:48.820 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:48.820+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:48.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:48.921 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:48.920+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:49.023 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.022+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.687399796000001, 2024-09-12T21:51:49.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:49.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:49.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.686078270000003, 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:49.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.685590427000001, 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:49.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.684863045999997, 2024-09-12T21:51:49.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:49.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:49.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:49.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:49.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.679068489000002, 2024-09-12T21:51:49.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:49.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.718018995000001, 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:49.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.717891536, 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:49.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.717832915999999, 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:49.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:49.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:49.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.71572127, 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:49.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:49.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:49.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.187 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.714064327999999, 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:49.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:49.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.713114729000001, 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:49.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:49.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.203 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.708890642, 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.204 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:49.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:49.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.706537103999999, 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:49.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:49.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:49.219 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.704913911999999, 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:49.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:49.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.9362193130000005, 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:49.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:49.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105346 5.a 5:540ff5c7:::benchmark_data_smithi053_32461_object105345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9380820800000009, 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023934706, 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105346 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089044+0000", 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089224+0000", 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179636 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089233+0000", 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3689999999999996e-06 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089240+0000", 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:49.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097718+0000", 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084781890000000006 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097868+0000", 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015013200000000001 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.098063+0000", 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194802 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110498+0000", 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435827 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112830+0000", 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023316470000000001 2024-09-12T21:51:49.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112891+0000", 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0609000000000002e-05 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112978+0000", 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7162000000000003e-05 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113761 5.a 5:5abfd87c:::benchmark_data_smithi053_32461_object113760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2902099209999998, 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023971421, 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113761 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736916+0000", 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736946+0000", 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0343000000000001e-05 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736955+0000", 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2549999999999997e-06 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736960+0000", 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7660000000000004e-06 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747370+0000", 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010409725999999999 2024-09-12T21:51:49.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747555+0000", 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000184604 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747720+0000", 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016520400000000001 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.755325+0000", 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076054080000000001 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760726+0000", 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054010550000000001 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760784+0000", 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7583000000000001e-05 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760887+0000", 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010287499999999999 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.81161298, 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:51:49.247 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:49.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:51:49.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51336773199999997, 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:51:49.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:51:49.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:49.259 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51035224499999998, 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:49.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:51:49.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:49.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:49.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:49.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:49.266 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:49.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:49.268 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.266+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:49.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 50 16 126513 126497 158.107 140.875 0.0142162 0.00632208 2024-09-12T21:51:49.368 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.367+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.396 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:49.396 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:49.414 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:49.415 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:49.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:49.418 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:49.419 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:49.419 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:49.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:49.473 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.472+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.570 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:49.569+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:49.615 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:49.615 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:49.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:49.671 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:49.670+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:49.773 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:49.773 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:49.773 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.771+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:49.873 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:49.872+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:49.935 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:49.936 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:49.949 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:49.994 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:49.993+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.075 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:50.074+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:50.104 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:50.104 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:50.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:50.201 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.200+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.277 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.276+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.310 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:50.311 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:50.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:50.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 51 16 128775 128759 157.779 141.375 0.00403413 0.00633544 2024-09-12T21:51:50.378 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:50.378+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:50.471 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:50.471 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:50.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:51:50.479 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.478+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:50.580 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.578+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.671 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:50.672 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:50.680 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:50.679+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:50.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:50.781 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:50.780+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:50.868 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:50.869 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:50.880 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:50.882 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.881+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:50.983 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:50.982+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:51.038 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:51.038 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:51.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:51.083 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.083+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:51.185 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:51.184+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:51.251 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:51.251 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:51.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:51.307 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:51.306+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:51.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 52 16 131109 131093 157.549 145.875 0.00644765 0.00634461 2024-09-12T21:51:51.388 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:51.386+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:51.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:51.462 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:51.462 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:51.474 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:51:51.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:51.516 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:51.515+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:51.550 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:51.568 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:51.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:51.572 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:51.587 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.587+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131697 5.d 5:b56e5b67:::benchmark_data_smithi053_32461_object131696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.613302+0000", 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0091523460000000004, 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091784029999999999, 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131697 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613302+0000", 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613302+0000", 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613303+0000", 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3200000000000004e-07 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613380+0000", 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6756999999999997e-05 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613393+0000", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3361e-05 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613420+0000", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6432e-05 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613477+0000", 2024-09-12T21:51:51.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7698000000000002e-05 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.613649+0000", 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000171585 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622403+0000", 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0087543599999999992 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.628 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131700 5.d 5:baa3e37d:::benchmark_data_smithi053_32461_object131699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.614750+0000", 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0077041460000000003, 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0077969520000000002, 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131700 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614750+0000", 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614750+0000", 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614751+0000", 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4199999999999995e-07 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614806+0000", 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5152000000000003e-05 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614813+0000", 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2949999999999996e-06 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.614819+0000", 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3090000000000003e-06 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.616199+0000", 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013805130000000001 2024-09-12T21:51:51.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.616313+0000", 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011396300000000001 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131703 5.7 5:e9129fd5:::benchmark_data_smithi053_32461_object131702:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.615730+0000", 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0067241990000000001, 2024-09-12T21:51:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068657179999999998, 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131703 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615730+0000", 2024-09-12T21:51:51.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615730+0000", 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615731+0000", 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3499999999999995e-07 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615808+0000", 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7018e-05 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615818+0000", 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5910000000000002e-06 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615822+0000", 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8149999999999996e-06 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615870+0000", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7664999999999998e-05 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615972+0000", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101432 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.616070+0000", 2024-09-12T21:51:51.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8119e-05 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619328+0000", 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032579430000000001 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131704 5.f 5:f1a055d3:::benchmark_data_smithi053_32461_object131703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.615835+0000", 2024-09-12T21:51:51.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0066191740000000002, 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068267609999999998, 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131704 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615835+0000", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615835+0000", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615836+0000", 2024-09-12T21:51:51.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615867+0000", 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1430000000000002e-05 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615875+0000", 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0290000000000005e-06 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615881+0000", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5589999999999996e-06 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.615941+0000", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.616085+0000", 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000144699 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.642 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:131706 5.5 e46/21 5:a3c78a65:::benchmark_data_smithi053_32461_object131705:head v 46'8226, mlcod=46'8224)", 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.617404+0000", 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0050506830000000003, 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052941999999999998, 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617404+0000", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617404+0000", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617404+0000", 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2500000000000001e-07 2024-09-12T21:51:51.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617463+0000", 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8414e-05 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617470+0000", 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9099999999999999e-06 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617475+0000", 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.203e-06 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617512+0000", 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7205e-05 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.617525+0000", 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3142000000000001e-05 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.646 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131708 5.1 5:8fc290f0:::benchmark_data_smithi053_32461_object131707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.618184+0000", 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0042702699999999996, 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045472350000000002, 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.647 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131708 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618184+0000", 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618184+0000", 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618186+0000", 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.325e-06 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618249+0000", 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3757000000000006e-05 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618260+0000", 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1077000000000001e-05 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618267+0000", 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1580000000000002e-06 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618314+0000", 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7889000000000002e-05 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618396+0000", 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1741000000000002e-05 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618487+0000", 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1129000000000001e-05 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.651 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131709 5.d 5:b9a37dc0:::benchmark_data_smithi053_32461_object131708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.618937+0000", 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0035174270000000001, 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003832912, 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131709 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.652 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618937+0000", 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618937+0000", 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.618938+0000", 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.89e-07 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619044+0000", 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000106881 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619052+0000", 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0879999999999997e-06 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619057+0000", 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5910000000000003e-06 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619320+0000", 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026288599999999999 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.655 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619452+0000", 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000131915 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:131710 5.3 e46/21 5:c4425bcb:::benchmark_data_smithi053_32461_object131709:head v 46'8353, mlcod=46'8351)", 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.619502+0000", 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029523489999999999, 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033027180000000001, 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.656 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619502+0000", 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619502+0000", 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619503+0000", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9999999999999998e-07 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619604+0000", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101841 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619613+0000", 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1170000000000004e-06 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619619+0000", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0939999999999996e-06 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619663+0000", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4302999999999999e-05 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619674+0000", 2024-09-12T21:51:51.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1153e-05 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131711 5.f 5:fbb643e5:::benchmark_data_smithi053_32461_object131710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.619517+0000", 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029374190000000001, 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033191480000000001, 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.660 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131711 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619517+0000", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619517+0000", 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619518+0000", 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1900000000000003e-07 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619678+0000", 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016025999999999999 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619686+0000", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9109999999999993e-06 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619692+0000", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7640000000000002e-06 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619731+0000", 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9845000000000002e-05 2024-09-12T21:51:51.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619852+0000", 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120468 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131712 5.f 5:f0d102fa:::benchmark_data_smithi053_32461_object131711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.619705+0000", 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027499019999999998, 2024-09-12T21:51:51.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031661950000000001, 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131712 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619705+0000", 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619705+0000", 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619705+0000", 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619733+0000", 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.743e-05 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619739+0000", 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6549999999999998e-06 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619748+0000", 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6969999999999999e-06 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622303+0000", 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025548820000000001 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622427+0000", 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000124611 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:131714 5.7 5:e12b406c:::benchmark_data_smithi053_32461_object131713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.619791+0000", 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002663955, 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031145859999999999, 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 131714 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619791+0000", 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619791+0000", 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619791+0000", 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619931+0000", 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014010499999999999 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619939+0000", 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.542e-06 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.619944+0000", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622307+0000", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023626979999999999 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622502+0000", 2024-09-12T21:51:51.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019531600000000001 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622627+0000", 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000124902 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:131717 5.5 e46/21 5:af019f45:::benchmark_data_smithi053_32461_object131716:head v 46'8227, mlcod=46'8224)", 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.620693+0000", 2024-09-12T21:51:51.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001761646, 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022479729999999999, 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620693+0000", 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620693+0000", 2024-09-12T21:51:51.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620693+0000", 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620761+0000", 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7908000000000001e-05 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620770+0000", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.14e-06 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620774+0000", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1139999999999999e-06 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620824+0000", 2024-09-12T21:51:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0173000000000002e-05 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.620845+0000", 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1583e-05 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:131713 5.3 e46/21 5:ceecc5df:::benchmark_data_smithi053_32461_object131712:head v 46'8354, mlcod=46'8351)", 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:51.621532+0000", 2024-09-12T21:51:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00092279999999999999, 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014384689999999999, 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621532+0000", 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:51.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621532+0000", 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621532+0000", 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621608+0000", 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5544999999999996e-05 2024-09-12T21:51:51.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621615+0000", 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3440000000000003e-06 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.621619+0000", 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1690000000000002e-06 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:51.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622193+0000", 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000574009 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:51.622212+0000", 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8986000000000001e-05 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 13 2024-09-12T21:51:51.681 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:51.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:51.724 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.723+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:51.789 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.788+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:51.869 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:51.869 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:51.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:51.921 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.921+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:51.989 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:51.989+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.733156303999998, 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:52.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:52.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:52.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:52.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.075 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.732883735999998, 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.076 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:52.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:52.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.732825810999998, 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.082 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:52.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:52.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.088 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.731753842000003, 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:52.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.091 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:52.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.728205260999999, 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:52.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:52.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.100 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.726888107000001, 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.101 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:52.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.106 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.726534032000004, 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:52.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.725926201999997, 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.111 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:52.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:52.115 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.725906760000001, 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:52.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:52.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:52.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:52.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.725200266999998, 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:52.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:52.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.919486344999999, 2024-09-12T21:51:52.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:52.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.755680169000001, 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.132 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:52.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:52.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.754058774000001, 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:52.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:52.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.753968745000002, 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:52.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:52.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:52.150 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.750797043999999, 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:52.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:52.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:52.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.156 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.750276789000001, 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:52.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:52.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.743693303000001, 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.163 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:52.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.731083491, 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.169 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:52.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.053147598999999, 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:52.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 21.052829157000001, 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.182 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:52.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:52.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:52.187 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:52.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:52.189 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.188+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.289 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.289+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133372 5.6 e46/36 5:694ebebb:::benchmark_data_smithi053_32461_object133371:head v 46'8371, mlcod=46'8368)", 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.333320+0000", 2024-09-12T21:51:52.345 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0099305880000000006, 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099522469999999991, 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333320+0000", 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333320+0000", 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333320+0000", 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2799999999999996e-07 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333399+0000", 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8763000000000005e-05 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333409+0000", 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7850000000000003e-06 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.333415+0000", 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7610000000000002e-06 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335464+0000", 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002048996 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335486+0000", 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1688999999999999e-05 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133377 5.e 5:71de1d0f:::benchmark_data_smithi053_32461_object133376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.334659+0000", 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085914860000000006, 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086786840000000007, 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133377 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334659+0000", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334659+0000", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334660+0000", 2024-09-12T21:51:52.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1209999999999999e-06 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334687+0000", 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7254999999999999e-05 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334696+0000", 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0350000000000007e-06 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.334704+0000", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2460000000000003e-06 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338915+0000", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042108919999999999 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339162+0000", 2024-09-12T21:51:52.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024654899999999999 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133375 5.6 e46/36 5:66cb54b6:::benchmark_data_smithi053_32461_object133374:head v 46'8372, mlcod=46'8368)", 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.335203+0000", 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080471250000000005, 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081977360000000006, 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335203+0000", 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335203+0000", 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335203+0000", 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1e-07 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335298+0000", 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4388000000000005e-05 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335306+0000", 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6440000000000006e-06 2024-09-12T21:51:52.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335311+0000", 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4619999999999998e-06 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337118+0000", 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018069010000000001 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337148+0000", 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0009999999999999e-05 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133380 5.8 5:144450c1:::benchmark_data_smithi053_32461_object133379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.335190+0000", 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080603129999999995, 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082692100000000008, 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133380 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335190+0000", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335190+0000", 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335191+0000", 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5899999999999995e-07 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335387+0000", 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196885 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335395+0000", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8399999999999995e-06 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335401+0000", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4199999999999998e-06 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335451+0000", 2024-09-12T21:51:52.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0076e-05 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335588+0000", 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013726600000000001 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133381 5.3 5:c6f805f1:::benchmark_data_smithi053_32461_object133380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.335415+0000", 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078352219999999993, 2024-09-12T21:51:52.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081090199999999998, 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133381 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335415+0000", 2024-09-12T21:51:52.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335415+0000", 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335416+0000", 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335441+0000", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335449+0000", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9389999999999997e-06 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335455+0000", 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1290000000000001e-06 2024-09-12T21:51:52.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336555+0000", 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010996140000000001 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336717+0000", 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016242900000000001 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336924+0000", 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000206228 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343126+0000", 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062024589999999996 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133382 5.e 5.f7be4d9e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.335674+0000", 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.007576429, 2024-09-12T21:51:52.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079220660000000002, 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133382 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335674+0000", 2024-09-12T21:51:52.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335674+0000", 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335674+0000", 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0399999999999996e-07 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335757+0000", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2989000000000001e-05 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335766+0000", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1069999999999994e-06 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.335776+0000", 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-09-12T21:51:52.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133384 5.0 5:0fe3dd95:::benchmark_data_smithi053_32461_object133383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.336650+0000", 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065997850000000004, 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070006770000000003, 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133384 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336650+0000", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336650+0000", 2024-09-12T21:51:52.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336651+0000", 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-07 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336892+0000", 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024074400000000001 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336902+0000", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.012e-05 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336911+0000", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7979999999999995e-06 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336958+0000", 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7534999999999998e-05 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337091+0000", 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013297 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133376 5.6 e46/36 5:652498b0:::benchmark_data_smithi053_32461_object133375:head v 46'8373, mlcod=46'8368)", 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.336957+0000", 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062928080000000004, 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067554779999999997, 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336957+0000", 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336957+0000", 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336958+0000", 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8299999999999998e-07 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336984+0000", 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6162000000000001e-05 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336990+0000", 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6150000000000002e-06 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.336995+0000", 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0839999999999999e-06 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338760+0000", 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764283 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338779+0000", 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9335e-05 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133385 5.5 5:a225810e:::benchmark_data_smithi053_32461_object133384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.337724+0000", 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055262569999999997, 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060463239999999996, 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133385 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337724+0000", 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337724+0000", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337725+0000", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0500000000000002e-07 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337792+0000", 2024-09-12T21:51:52.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6741000000000004e-05 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337805+0000", 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2999999999999999e-05 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337813+0000", 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2279999999999998e-06 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337869+0000", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6527999999999998e-05 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.337958+0000", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9028000000000002e-05 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338039+0000", 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0511000000000002e-05 2024-09-12T21:51:52.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341741+0000", 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00370243 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133378 5.6 e46/36 5:6933d9d8:::benchmark_data_smithi053_32461_object133377:head v 46'8374, mlcod=46'8368)", 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.338919+0000", 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043315000000000003, 2024-09-12T21:51:52.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049224810000000003, 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338919+0000", 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338919+0000", 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338919+0000", 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000002e-07 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338947+0000", 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8245000000000001e-05 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338955+0000", 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.763e-06 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.338961+0000", 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6380000000000001e-06 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.340324+0000", 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001363426 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.340349+0000", 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4579e-05 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133387 5.3 5:cffedc75:::benchmark_data_smithi053_32461_object133386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.339232+0000", 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040177529999999998, 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004673267, 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133387 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339232+0000", 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339232+0000", 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339233+0000", 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0020000000000001e-06 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339333+0000", 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9154999999999995e-05 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339342+0000", 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7380000000000006e-06 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339350+0000", 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339393+0000", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2963999999999997e-05 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339515+0000", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122889 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339667+0000", 2024-09-12T21:51:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015116399999999999 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133388 5.6 e46/36 5:6626ae0e:::benchmark_data_smithi053_32461_object133387:head v 46'8375, mlcod=46'8368)", 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.339894+0000", 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033561699999999999, 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004077504, 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339894+0000", 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339894+0000", 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339894+0000", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2399999999999999e-07 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339981+0000", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7017999999999999e-05 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339990+0000", 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8259999999999999e-06 2024-09-12T21:51:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.339995+0000", 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3560000000000003e-06 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.342973+0000", 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029780140000000002 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.342986+0000", 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2921999999999999e-05 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133389 5.0 5:0780a7cd:::benchmark_data_smithi053_32461_object133388:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.341791+0000", 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001459084, 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022374119999999998, 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133389 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341791+0000", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341791+0000", 2024-09-12T21:51:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341792+0000", 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4499999999999997e-07 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341843+0000", 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1227999999999998e-05 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341849+0000", 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4699999999999999e-06 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341853+0000", 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9040000000000002e-06 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341894+0000", 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0828000000000003e-05 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.341990+0000", 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6220999999999999e-05 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:133390 5.a 5:57f5b756:::benchmark_data_smithi053_32461_object133389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.343176+0000", 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4376999999999996e-05, 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091524300000000005, 2024-09-12T21:51:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 133390 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343176+0000", 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343176+0000", 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343177+0000", 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4900000000000004e-07 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343231+0000", 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4487000000000002e-05 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343242+0000", 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0742e-05 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343249+0000", 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4830000000000002e-06 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343650+0000", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040068999999999999 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343747+0000", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6900999999999999e-05 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.343841+0000", 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3696000000000006e-05 2024-09-12T21:51:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:133370 5.6 e46/36 5:63e9d418:::benchmark_data_smithi053_32461_object133369:head v 46'8370, mlcod=46'8368)", 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:52.330879+0000", 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012371026, 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01328176, 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330879+0000", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330879+0000", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330880+0000", 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4700000000000001e-07 2024-09-12T21:51:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330910+0000", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.042e-05 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330920+0000", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0213e-05 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.330926+0000", 2024-09-12T21:51:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6489999999999996e-06 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.332777+0000", 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018512089999999999 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:52.332795+0000", 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8023999999999999e-05 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-09-12T21:51:52.410 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:52.411 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 53 16 133423 133407 157.305 144.625 0.00787971 0.0063544 2024-09-12T21:51:52.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:52.412 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:52.410+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:52.512 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.511+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.606 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:52.607 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:52.607 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:52.607 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:52.607 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:52.612 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.611+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:52.713 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.713+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.434310762999999, 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:52.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.432989237000001, 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:52.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.432501393999999, 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:52.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:52.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.431774013000002, 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:52.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:52.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.425979456, 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:52.805 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:52.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:52.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.464929961999999, 2024-09-12T21:51:52.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.464802503000001, 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.464743883000001, 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:52.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:52.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.462632237000001, 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:52.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:52.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.460975295000001, 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:52.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:52.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.460025695999999, 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:52.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:52.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.455801609000002, 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:52.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:52.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.453448071, 2024-09-12T21:51:52.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:52.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.451824879, 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.859 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:52.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.68313028, 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:52.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:52.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:52.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:105346 5.a 5:540ff5c7:::benchmark_data_smithi053_32461_object105345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:52.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.684993047000001, 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023934706, 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 105346 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089043+0000", 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089044+0000", 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089224+0000", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179636 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089233+0000", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3689999999999996e-06 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.089240+0000", 2024-09-12T21:51:52.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097718+0000", 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084781890000000006 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.097868+0000", 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015013200000000001 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.098063+0000", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194802 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.110498+0000", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435827 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112830+0000", 2024-09-12T21:51:52.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023316470000000001 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112891+0000", 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0609000000000002e-05 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:40.112978+0000", 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7162000000000003e-05 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:113761 5.a 5:5abfd87c:::benchmark_data_smithi053_32461_object113760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0371208880000005, 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023971421, 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113761 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736915+0000", 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736916+0000", 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0200000000000002e-07 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736946+0000", 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0343000000000001e-05 2024-09-12T21:51:52.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736955+0000", 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2549999999999997e-06 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.736960+0000", 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7660000000000004e-06 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747370+0000", 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010409725999999999 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747555+0000", 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000184604 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.747720+0000", 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016520400000000001 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.755325+0000", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076054080000000001 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760726+0000", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054010550000000001 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760784+0000", 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7583000000000001e-05 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:43.760887+0000", 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010287499999999999 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.5585239470000003, 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:51:52.884 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:52.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.889 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2602786989999997, 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:51:52.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:51:52.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2572632119999998, 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:52.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:51:52.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:51:52.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:52.902 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:52.903 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:52.903+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:52.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:53.005 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.004+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.049 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:134980 5.6 5:6385737c:::benchmark_data_smithi053_32461_object134979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:53.042551+0000", 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0060874290000000001, 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061138649999999996, 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.050 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 134980 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042551+0000", 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042551+0000", 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042551+0000", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0699999999999996e-07 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042603+0000", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1631000000000001e-05 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042608+0000", 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4940000000000003e-06 2024-09-12T21:51:53.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042612+0000", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4989999999999999e-06 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042655+0000", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3170000000000002e-05 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042767+0000", 2024-09-12T21:51:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111685 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.042849+0000", 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2404000000000006e-05 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045326+0000", 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024765490000000002 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:134986 5.6 5:62b29f2e:::benchmark_data_smithi053_32461_object134985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:53.045573+0000", 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0030646940000000002, 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031829829999999999, 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 134986 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045573+0000", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045573+0000", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045574+0000", 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8899999999999998e-07 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045673+0000", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9165000000000003e-05 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045685+0000", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1897e-05 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045693+0000", 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1049999999999995e-06 2024-09-12T21:51:53.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045752+0000", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8393000000000001e-05 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.045895+0000", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000143611 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046053+0000", 2024-09-12T21:51:53.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015802700000000001 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048478+0000", 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024241319999999998 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:134985 5.c e46/21 5:3b621d20:::benchmark_data_smithi053_32461_object134984:head v 46'8357, mlcod=46'8355)", 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:53.046463+0000", 2024-09-12T21:51:53.059 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002174713, 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023693910000000002, 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046463+0000", 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046463+0000", 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046464+0000", 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8299999999999998e-07 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046490+0000", 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6854000000000001e-05 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046498+0000", 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1609999999999997e-06 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046502+0000", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4970000000000003e-06 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046545+0000", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3309000000000002e-05 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.046561+0000", 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6053999999999999e-05 2024-09-12T21:51:53.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:134990 5.3 e46/21 5:ca36eff3:::benchmark_data_smithi053_32461_object134989:head v 46'8564, mlcod=46'8561)", 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:53.048394+0000", 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00024397199999999999, 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00049287300000000001, 2024-09-12T21:51:53.064 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048394+0000", 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048394+0000", 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048395+0000", 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0800000000000004e-07 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048428+0000", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3491000000000002e-05 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048445+0000", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6305000000000001e-05 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048451+0000", 2024-09-12T21:51:53.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0719999999999996e-06 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048495+0000", 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4229e-05 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048508+0000", 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2867999999999999e-05 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:134991 5.c e46/21 5:3f44a8da:::benchmark_data_smithi053_32461_object134990:head v 46'8358, mlcod=46'8355)", 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:53.048560+0000", 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.7896000000000001e-05, 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00038014199999999998, 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048560+0000", 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048560+0000", 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048561+0000", 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8400000000000004e-07 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048618+0000", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7200999999999997e-05 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048628+0000", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0477e-05 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048635+0000", 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8129999999999998e-06 2024-09-12T21:51:53.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048688+0000", 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3223000000000002e-05 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:53.048709+0000", 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0652000000000001e-05 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.072 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:53.073 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 5 2024-09-12T21:51:53.073 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:53.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:53.115 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.114+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.207 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.207+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.254 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:53.255 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:53.255 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:53.255 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:53.255 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:53.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:53.309 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.308+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 54 16 135705 135689 157.033 142.625 0.00303182 0.00636541 2024-09-12T21:51:53.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-09-12T21:51:53.409 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:53.408+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:53.452 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:53.452 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:53.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:53.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.117331833000001, 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:53.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:53.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:53.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.117059265000002, 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:53.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:53.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:53.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.117001340000002, 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.465 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:53.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:53.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.471 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.115929371, 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:53.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:53.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:53.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.112380790000003, 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:53.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:53.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.111063635999997, 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:53.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:53.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:53.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.110709561, 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:53.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.110101731, 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.494 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:53.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.110082288999998, 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:53.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:53.502 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 41.109375796000002, 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:53.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.303661873999999, 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:53.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:53.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:53.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.139855697999998, 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.513 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:53.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:53.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.138234302999997, 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.519 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:53.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.138144273999998, 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.531 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.134972572999999, 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.532 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:53.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:53.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.134452318000001, 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.538 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:53.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:53.543 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.127868831999997, 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.544 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:53.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:53.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 32.115259020000003, 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.553 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:53.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:53.558 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.437323127999999, 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.559 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:53.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.437004686000002, 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:53.565 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:53.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:53.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.570 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.571 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:53.571 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:53.571 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:53.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:51:53.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:53.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:53.574 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:53.571+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:53.674 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:53.673+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:53.714 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:53.715 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:136547 5.7 e46/21 5:e21640f2:::benchmark_data_smithi053_32461_object136546:head v 46'8555, mlcod=46'8553)", 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.719250+0000", 2024-09-12T21:51:53.722 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017902510000000001, 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018096880000000001, 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719250+0000", 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719250+0000", 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719250+0000", 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.44e-07 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719318+0000", 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7941999999999994e-05 2024-09-12T21:51:53.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719339+0000", 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0649000000000002e-05 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719346+0000", 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5899999999999996e-06 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719395+0000", 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9147000000000002e-05 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.719414+0000", 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.908e-05 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136532 5.2 5:4c1e4847:::benchmark_data_smithi053_32461_object136531:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.712044+0000", 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089958139999999995, 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090554250000000006, 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136532 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712044+0000", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712044+0000", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712045+0000", 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.85e-07 2024-09-12T21:51:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712135+0000", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0066000000000001e-05 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712142+0000", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0829999999999998e-06 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712148+0000", 2024-09-12T21:51:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3750000000000002e-06 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715132+0000", 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029843069999999998 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715278+0000", 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014624000000000001 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715420+0000", 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014202299999999999 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136536 5.5 5:a71a38ce:::benchmark_data_smithi053_32461_object136535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.712737+0000", 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.008302762, 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084046869999999992, 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136536 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712737+0000", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712737+0000", 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712738+0000", 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712795+0000", 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6721999999999997e-05 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712810+0000", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4929999999999999e-05 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712814+0000", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6029999999999998e-06 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712902+0000", 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7742000000000001e-05 2024-09-12T21:51:53.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713058+0000", 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015565300000000001 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713143+0000", 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5418000000000001e-05 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:53.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716772+0000", 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036289 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136537 5.5 5:a38d3e6e:::benchmark_data_smithi053_32461_object136536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.712838+0000", 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082026149999999999, 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083463340000000004, 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136537 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712838+0000", 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712838+0000", 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712838+0000", 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9099999999999999e-07 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712870+0000", 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1588999999999999e-05 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712877+0000", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6299999999999998e-06 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.712883+0000", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4550000000000003e-06 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714745+0000", 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018621449999999999 2024-09-12T21:51:53.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714868+0000", 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012339499999999999 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714994+0000", 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012536900000000001 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136538 5.5 5:a1bc9fdc:::benchmark_data_smithi053_32461_object136537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.713678+0000", 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0073622469999999997, 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075436649999999997, 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136538 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.741 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713678+0000", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713678+0000", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713679+0000", 2024-09-12T21:51:53.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6499999999999998e-07 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713707+0000", 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8442999999999999e-05 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713718+0000", 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0545e-05 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.713725+0000", 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2949999999999996e-06 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716823+0000", 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030982560000000002 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716980+0000", 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156687 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717135+0000", 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015544699999999999 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136539 5.4 5:241f5c4f:::benchmark_data_smithi053_32461_object136538:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.714496+0000", 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065440339999999998, 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00676298, 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136539 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714496+0000", 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714496+0000", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714497+0000", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714579+0000", 2024-09-12T21:51:53.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1749999999999995e-05 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714587+0000", 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6899999999999998e-06 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714593+0000", 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7039999999999999e-06 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714645+0000", 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1906000000000001e-05 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.714774+0000", 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012859699999999999 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:136535 5.1 e46/36 5:8480075b:::benchmark_data_smithi053_32461_object136534:head v 46'8500, mlcod=46'8496)", 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.715204+0000", 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058363369999999996, 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060881110000000002, 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715204+0000", 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715204+0000", 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715205+0000", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000004e-07 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715236+0000", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1275999999999997e-05 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715245+0000", 2024-09-12T21:51:53.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0520000000000007e-06 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715253+0000", 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1859999999999992e-06 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715293+0000", 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0358000000000002e-05 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715312+0000", 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8122e-05 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136541 5.8 5:1170935b:::benchmark_data_smithi053_32461_object136540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.715309+0000", 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057307959999999998, 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060152199999999999, 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136541 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715309+0000", 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715309+0000", 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715310+0000", 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-07 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715375+0000", 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4901999999999996e-05 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715386+0000", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0927000000000001e-05 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715395+0000", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6899999999999998e-06 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715457+0000", 2024-09-12T21:51:53.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2386999999999997e-05 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.715616+0000", 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015917500000000001 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136542 5.b 5:dbbd3da3:::benchmark_data_smithi053_32461_object136541:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.716752+0000", 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042878819999999998, 2024-09-12T21:51:53.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046063299999999996, 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136542 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716752+0000", 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716752+0000", 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716753+0000", 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9099999999999991e-07 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716891+0000", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138071 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716901+0000", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716909+0000", 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6140000000000003e-06 2024-09-12T21:51:53.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716969+0000", 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0645e-05 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717246+0000", 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276373 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136544 5.0 5:01cc0940:::benchmark_data_smithi053_32461_object136543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.716944+0000", 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040961260000000003, 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044486480000000004, 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.764 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136544 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716944+0000", 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716944+0000", 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.716945+0000", 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1299999999999999e-07 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717070+0000", 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012480400000000001 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717080+0000", 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0155e-05 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717087+0000", 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9e-06 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717142+0000", 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5461999999999999e-05 2024-09-12T21:51:53.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717267+0000", 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012500900000000001 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:136540 5.1 e46/36 5:86c5b25c:::benchmark_data_smithi053_32461_object136539:head v 46'8501, mlcod=46'8497)", 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.717144+0000", 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038957499999999999, 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042809010000000002, 2024-09-12T21:51:53.768 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717144+0000", 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717144+0000", 2024-09-12T21:51:53.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717145+0000", 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717230+0000", 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4927999999999997e-05 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717253+0000", 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3345000000000001e-05 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717260+0000", 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2990000000000002e-06 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717314+0000", 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4561000000000002e-05 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.717341+0000", 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7189999999999999e-05 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136545 5.4 5:2acfecaa:::benchmark_data_smithi053_32461_object136544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.718145+0000", 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028947170000000002, 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033110029999999999, 2024-09-12T21:51:53.772 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136545 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718145+0000", 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718145+0000", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718146+0000", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9999999999999996e-07 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718215+0000", 2024-09-12T21:51:53.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9102000000000003e-05 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718227+0000", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1551e-05 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718234+0000", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8909999999999998e-06 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718285+0000", 2024-09-12T21:51:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1483000000000002e-05 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718403+0000", 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011752300000000001 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:136546 5.3 5:cc91bd23:::benchmark_data_smithi053_32461_object136545:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.718251+0000", 2024-09-12T21:51:53.776 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027893250000000001, 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032395459999999998, 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136546 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:53.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718251+0000", 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718251+0000", 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718251+0000", 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2e-07 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718279+0000", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7195999999999998e-05 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718286+0000", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1049999999999997e-06 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718291+0000", 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1039999999999998e-06 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718334+0000", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3188000000000001e-05 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718445+0000", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111264 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.718567+0000", 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122069 2024-09-12T21:51:53.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-09-12T21:51:53.781 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:53.782 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:53.782 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.781+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.783 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:53.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:53.784 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:53.784 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:53.882 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.882+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.980 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:53.980 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:53.983 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:53.983+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:53.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:54.084 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:54.083+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:54.146 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:54.146 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:54.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:54.185 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:54.184+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:54.286 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:54.285+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:54.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:54.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 55 16 137977 137961 156.76 142 0.00871835 0.00637653 2024-09-12T21:51:54.387 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:54.387+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:54.469 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:54.470 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:51:54.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:54.488 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:54.487+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:54.589 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:54.588+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:54.667 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:54.668 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:54.681 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:54.690 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:54.689+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:54.791 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:54.789+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:54.837 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:54.837 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:54.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:54.891 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:54.891+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:54.993 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:54.992+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:55.043 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.043 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.058 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:55.102 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.101+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.195 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.194+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.210 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.210 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:55.295 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.294+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 56 16 140232 140216 156.477 140.938 0.00322946 0.00638819 2024-09-12T21:51:55.369 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.370 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:55.429 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:55.428+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:55.497 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:55.497+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:55.528 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.529 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:55.625 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:55.624+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:55.699 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.698+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.725 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.725 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:55.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:51:55.800 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.799+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.893 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:55.893 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:55.901 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:55.900+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:55.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:55.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:55.933 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:55.936 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:55.937 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:56.002 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:56.001+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:56.103 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:56.103 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:56.103 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:56.102+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:56.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:56.204 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.203+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.305 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.304+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.313 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:56.313 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:56.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.970215971999998, 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:56.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.968894446, 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:56.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.968406602999998, 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:56.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:56.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.967679222000001, 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:56.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:56.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:56.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.961884664999999, 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:56.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:56.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.000835170999999, 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:56.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:56.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.000707712000001, 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:56.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.000649092000003, 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:56.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.998537446, 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:56.362 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:56.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:56.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:56.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.996880504000003, 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:56.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:56.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.995930905000002, 2024-09-12T21:51:56.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:56.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:56.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:56.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.991706817999997, 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:56.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:56.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:56.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.989353280000003, 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:56.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.398 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.987730087999999, 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:56.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:56.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:56.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.219035488999999, 2024-09-12T21:51:56.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:56.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:56.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:56.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:56.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0944291560000003, 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:51:56.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.7961839079999997, 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:51:56.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:51:56.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.7931684209999998, 2024-09-12T21:51:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:51:56.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:51:56.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.936806153, 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:51:56.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:51:56.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:56.441 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.9362753029999999, 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:56.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:56.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:51:56.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:51:56.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:56.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:56.451 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 57 16 142505 142489 156.224 142.062 0.00609894 0.00639841 2024-09-12T21:51:56.451 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.450+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:56.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:51:56.551 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.551+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:143054 5.c e47/21 5:3295a564:::benchmark_data_smithi053_32461_object143053:head v 47'8844, mlcod=47'8841)", 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.593812+0000", 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031348510000000001, 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003155681, 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.599 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593812+0000", 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593812+0000", 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.600 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593812+0000", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8699999999999995e-07 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593862+0000", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9134000000000001e-05 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593871+0000", 2024-09-12T21:51:56.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8260000000000005e-06 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593878+0000", 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6370000000000002e-06 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593921+0000", 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2561999999999997e-05 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593938+0000", 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7129000000000002e-05 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143057 5.d 5:b8d4614e:::benchmark_data_smithi053_32461_object143056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.593912+0000", 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0030343380000000001, 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031168839999999999, 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.603 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143057 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593912+0000", 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593912+0000", 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593913+0000", 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593970+0000", 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7317e-05 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593977+0000", 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7549999999999997e-06 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593981+0000", 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.985e-06 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594025+0000", 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4149e-05 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594145+0000", 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120117 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143058 5.d 5:b2de486f:::benchmark_data_smithi053_32461_object143057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.610 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.593994+0000", 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029522260000000001, 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030978749999999999, 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143058 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593994+0000", 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593994+0000", 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.593995+0000", 2024-09-12T21:51:56.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-07 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594027+0000", 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1548999999999999e-05 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594035+0000", 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1000000000000004e-06 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594041+0000", 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1990000000000003e-06 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596369+0000", 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023284640000000001 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596510+0000", 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014068899999999999 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143059 5.6 5:6db597ba:::benchmark_data_smithi053_32461_object143058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.594051+0000", 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00289595, 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031015119999999998, 2024-09-12T21:51:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143059 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594051+0000", 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594051+0000", 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594051+0000", 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6899999999999997e-07 2024-09-12T21:51:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594078+0000", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7149999999999999e-05 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594087+0000", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7029999999999995e-06 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594093+0000", 2024-09-12T21:51:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7710000000000003e-06 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594337+0000", 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024390699999999999 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594469+0000", 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013200199999999999 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594613+0000", 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014402800000000001 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143060 5.1 5:85241c79:::benchmark_data_smithi053_32461_object143059:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.594101+0000", 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028453950000000001, 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031213159999999998, 2024-09-12T21:51:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143060 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594101+0000", 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594101+0000", 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594102+0000", 2024-09-12T21:51:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6400000000000003e-07 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594129+0000", 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6769000000000001e-05 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594136+0000", 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4240000000000004e-06 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594141+0000", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1560000000000003e-06 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594174+0000", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3013999999999999e-05 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594259+0000", 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5315999999999994e-05 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.594342+0000", 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2226999999999997e-05 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596917+0000", 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025753490000000002 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:143061 5.5 e47/21 5:aceb19e7:::benchmark_data_smithi053_32461_object143060:head v 47'8897, mlcod=47'8895)", 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.595112+0000", 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001834458, 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021787529999999999, 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595112+0000", 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595112+0000", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595113+0000", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2799999999999996e-07 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595172+0000", 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9239e-05 2024-09-12T21:51:56.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595180+0000", 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6920000000000002e-06 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595185+0000", 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0699999999999997e-06 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596356+0000", 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001170953 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596373+0000", 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6790999999999999e-05 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:143055 5.c e47/21 5:3a479c29:::benchmark_data_smithi053_32461_object143054:head v 47'8845, mlcod=47'8841)", 2024-09-12T21:51:56.629 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.595872+0000", 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010745850000000001, 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001469847, 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595872+0000", 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595872+0000", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595873+0000", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0999999999999999e-07 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595948+0000", 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5393000000000001e-05 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595958+0000", 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6930000000000002e-06 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.595964+0000", 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3230000000000003e-06 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596011+0000", 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7030000000000002e-05 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596030+0000", 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9368000000000002e-05 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.633 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:143063 5.2 e47/36 5:485d8d15:::benchmark_data_smithi053_32461_object143062:head v 47'8728, mlcod=47'8726)", 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.596536+0000", 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000410744, 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00085901300000000005, 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596536+0000", 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596536+0000", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596537+0000", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7899999999999998e-07 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596593+0000", 2024-09-12T21:51:56.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6851999999999997e-05 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596603+0000", 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5089999999999999e-06 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596609+0000", 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3790000000000003e-06 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596688+0000", 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8843000000000004e-05 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596709+0000", 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0664000000000001e-05 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.637 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143042 5.6 5:6fdffa6b:::benchmark_data_smithi053_32461_object143041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.588071+0000", 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0088754750000000007, 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0093866420000000006, 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.638 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143042 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588071+0000", 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588071+0000", 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588080+0000", 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1430000000000004e-06 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588106+0000", 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6052000000000001e-05 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588115+0000", 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2849999999999995e-06 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588120+0000", 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7790000000000001e-06 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588161+0000", 2024-09-12T21:51:56.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0713999999999997e-05 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588301+0000", 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013959899999999999 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588391+0000", 2024-09-12T21:51:56.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0610000000000002e-05 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596498+0000", 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0081061210000000009 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143044 5.6 5:6d0eb986:::benchmark_data_smithi053_32461_object143043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.588323+0000", 2024-09-12T21:51:56.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0086239149999999994, 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092073659999999998, 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143044 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588323+0000", 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588323+0000", 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588324+0000", 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8100000000000002e-07 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588416+0000", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2728999999999999e-05 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588426+0000", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5429999999999999e-06 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.588438+0000", 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1939e-05 2024-09-12T21:51:56.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590289+0000", 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001851278 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590402+0000", 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113106 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:56.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590543+0000", 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014075599999999999 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596508+0000", 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0059646159999999998 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:143049 5.6 5:63ce89ac:::benchmark_data_smithi053_32461_object143048:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:56.590538+0000", 2024-09-12T21:51:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00640881, 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0070628269999999998, 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 143049 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:56.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590538+0000", 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590538+0000", 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590539+0000", 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999996e-07 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590649+0000", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010987 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590660+0000", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1855000000000001e-05 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.590668+0000", 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7819999999999994e-06 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.592330+0000", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001661463 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.592475+0000", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014571000000000001 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.592616+0000", 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014077299999999999 2024-09-12T21:51:56.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:56.596513+0000", 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038964300000000002 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 11 2024-09-12T21:51:56.653 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:56.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:56.655 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.654+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.755 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:56.754+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:56.834 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:51:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:51:56.834 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:51:56.834 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:56.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:56.857 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:56.856+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:56.957 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:56.957+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:56.999 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:56.999 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.664331773999997, 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:51:57.000 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:51:57.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:51:57.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:51:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.664059205999997, 2024-09-12T21:51:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:57.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:51:57.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.664001280999997, 2024-09-12T21:51:57.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:51:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.662929312000003, 2024-09-12T21:51:57.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:51:57.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:51:57.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.024 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.659380730999999, 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:51:57.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.030 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.658063577, 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:51:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.036 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.657709502000003, 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:51:57.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.657101672000003, 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:51:57.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.65708223, 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:57.045 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:51:57.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.656375736999998, 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:51:57.049 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:51:57.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.850661815000002, 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:51:57.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:51:57.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.686855639000001, 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:51:57.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:51:57.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:51:57.065 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.685234244, 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.066 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:51:57.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:51:57.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.685144215000001, 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.072 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:57.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:51:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.681972514000002, 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.078 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:51:57.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.681452258999997, 2024-09-12T21:51:57.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:51:57.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.089 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.090 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.674868773, 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:51:57.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:51:57.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.662258960999999, 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.097 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:51:57.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:51:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:51:57.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.984323068999998, 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.104 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.105 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:51:57.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.107 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:51:57.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84411 5.f 5:f0a9ff37:::benchmark_data_smithi053_32461_object84410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.984004627000001, 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023623881999999999, 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84411 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012682+0000", 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012683+0000", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012767+0000", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3882999999999996e-05 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012777+0000", 2024-09-12T21:51:57.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0113e-05 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012783+0000", 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.336e-06 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023446+0000", 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010662952999999999 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023540+0000", 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.31e-05 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036233+0000", 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012693654 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036262+0000", 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8643999999999999e-05 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036306+0000", 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4496999999999998e-05 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.115 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:57.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:57.117 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:57.115+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:57.218 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:57.217+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:144596 5.7 e47/21 5:ef92978d:::benchmark_data_smithi053_32461_object144595:head v 47'9029, mlcod=47'9027)", 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.267548+0000", 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026349590000000001, 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026600180000000001, 2024-09-12T21:51:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267548+0000", 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267548+0000", 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267548+0000", 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6899999999999997e-07 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267604+0000", 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5643999999999998e-05 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267613+0000", 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5459999999999992e-06 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267619+0000", 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6200000000000001e-06 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267694+0000", 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4746999999999994e-05 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267712+0000", 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216999999999999e-05 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:144598 5.1 e47/36 5:884ce60a:::benchmark_data_smithi053_32461_object144597:head v 47'9002, mlcod=47'9000)", 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.268439+0000", 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017439039999999999, 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018276659999999999, 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268439+0000", 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268439+0000", 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268439+0000", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7500000000000001e-07 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268466+0000", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6480999999999999e-05 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268474+0000", 2024-09-12T21:51:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1270000000000003e-06 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268479+0000", 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4229999999999996e-06 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268520+0000", 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0534999999999997e-05 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268543+0000", 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3201999999999999e-05 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144599 5.2 5:44891780:::benchmark_data_smithi053_32461_object144598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.268966+0000", 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001216633, 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013613989999999999, 2024-09-12T21:51:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144599 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268966+0000", 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268966+0000", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268967+0000", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3399999999999997e-07 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.268992+0000", 2024-09-12T21:51:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4618999999999999e-05 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269002+0000", 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0189e-05 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269008+0000", 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.251e-06 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269124+0000", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116266 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269257+0000", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013316200000000001 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269404+0000", 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014631099999999999 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:144597 5.7 e47/21 5:edf1f7ab:::benchmark_data_smithi053_32461_object144596:head v 47'9030, mlcod=47'9027)", 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.269664+0000", 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00051911800000000005, 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000730732, 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269664+0000", 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269664+0000", 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269664+0000", 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9800000000000003e-07 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269692+0000", 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7453e-05 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269699+0000", 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6809999999999998e-06 2024-09-12T21:51:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269706+0000", 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.28e-06 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269752+0000", 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6615e-05 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269770+0000", 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8193999999999999e-05 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:144600 5.6 e47/36 5:61c58ac7:::benchmark_data_smithi053_32461_object144599:head v 47'9114, mlcod=47'9111)", 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.269729+0000", 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00045319000000000002, 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071772999999999997, 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269729+0000", 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269729+0000", 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269730+0000", 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8999999999999998e-07 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269765+0000", 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4882000000000002e-05 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269771+0000", 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.472e-06 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269776+0000", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8679999999999998e-06 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269823+0000", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6581e-05 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.269841+0000", 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8816000000000001e-05 2024-09-12T21:51:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144601 5.2 5.a4696dd2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.270049+0000", 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00013383199999999999, 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0004504, 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144601 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270049+0000", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270049+0000", 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270050+0000", 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0699999999999999e-06 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270111+0000", 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0874e-05 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270120+0000", 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1880000000000008e-06 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270126+0000", 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2659999999999998e-06 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144582 5.b 5:dba3cfbb:::benchmark_data_smithi053_32461_object144581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.261898+0000", 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082845320000000007, 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086561889999999999, 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144582 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261898+0000", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261898+0000", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261899+0000", 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7000000000000004e-07 2024-09-12T21:51:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261924+0000", 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5111000000000001e-05 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261934+0000", 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880000000000001e-06 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.261940+0000", 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2720000000000003e-06 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265260+0000", 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033196469999999998 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265410+0000", 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044599999999999 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144583 5.b 5:df2ee15c:::benchmark_data_smithi053_32461_object144582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.262102+0000", 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080810729999999994, 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085139359999999997, 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144583 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262102+0000", 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262102+0000", 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262102+0000", 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0900000000000001e-07 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262253+0000", 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015052800000000001 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262261+0000", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3000000000000002e-06 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262268+0000", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267523+0000", 2024-09-12T21:51:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005254847 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267647+0000", 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124664 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144585 5.3 5:c8849938:::benchmark_data_smithi053_32461_object144584:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.262957+0000", 2024-09-12T21:51:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.007225548, 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077224290000000003, 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144585 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262957+0000", 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262957+0000", 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262958+0000", 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262985+0000", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7059999999999998e-05 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262993+0000", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.262998+0000", 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6250000000000004e-06 2024-09-12T21:51:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267517+0000", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045182010000000003 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267636+0000", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011923599999999999 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267829+0000", 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000193365 2024-09-12T21:51:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144587 5.b 5:da0f6886:::benchmark_data_smithi053_32461_object144586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.263164+0000", 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0070189379999999997, 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075825789999999999, 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144587 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263164+0000", 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263164+0000", 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263165+0000", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5099999999999999e-07 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263220+0000", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5909000000000003e-05 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263232+0000", 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1865000000000001e-05 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263239+0000", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1239999999999999e-06 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270354+0000", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071145899999999996 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.270493+0000", 2024-09-12T21:51:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139455 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144589 5.b 5.79d30a6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.263451+0000", 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067313060000000003, 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073515459999999996, 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144589 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263451+0000", 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263451+0000", 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263452+0000", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9299999999999997e-07 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263485+0000", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2669999999999997e-05 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263493+0000", 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7460000000000006e-06 2024-09-12T21:51:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.263501+0000", 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7510000000000008e-06 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144592 5.b 5.b9afd2bb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.265339+0000", 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048440269999999999, 2024-09-12T21:51:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055125759999999999, 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144592 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265339+0000", 2024-09-12T21:51:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265339+0000", 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265339+0000", 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.75e-07 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265408+0000", 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8875999999999996e-05 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265416+0000", 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265422+0000", 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9030000000000001e-06 2024-09-12T21:51:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:144593 5.b 5.b2f285cb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.265519+0000", 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046637919999999999, 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053836489999999999, 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144593 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265519+0000", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265519+0000", 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265520+0000", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6300000000000005e-07 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265623+0000", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103527 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265630+0000", 2024-09-12T21:51:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3440000000000003e-06 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.265637+0000", 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3300000000000004e-06 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:144595 5.6 e47/36 5:690ed6c0:::benchmark_data_smithi053_32461_object144594:head v 47'9113, mlcod=47'9111)", 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:57.267232+0000", 2024-09-12T21:51:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002951183, 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037215120000000002, 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267232+0000", 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267232+0000", 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267232+0000", 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1099999999999996e-07 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267292+0000", 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9644e-05 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267303+0000", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0844e-05 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267309+0000", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267360+0000", 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1391000000000003e-05 2024-09-12T21:51:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:57.267393+0000", 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2666999999999997e-05 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-09-12T21:51:57.328 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:57.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:57.330 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:57.329+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:57.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 58 16 144795 144779 155.998 143.125 0.00235291 0.00640723 2024-09-12T21:51:57.431 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:57.429+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:57.481 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:57.481 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:51:57.482 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:51:57.482 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:51:57.482 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:51:57.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:57.537 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:57.536+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:57.633 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:57.632+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:57.696 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:51:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.353635771, 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:51:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:51:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.352314245000002, 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:51:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:51:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:51:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.351826402, 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:51:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:51:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:51:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.351099021000003, 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.345304464000002, 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:51:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:51:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:51:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:51:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:51:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.384254970000001, 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:51:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.384127511000003, 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:51:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:51:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.384068890999998, 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:51:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.381957245000002, 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.380300302999999, 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:51:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:51:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:51:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.379350703999997, 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:51:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:51:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.375126616999999, 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:51:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.372773078999998, 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:51:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.371149887000001, 2024-09-12T21:51:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:51:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:51:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.602455288000002, 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:51:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.477848955000001, 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:51:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:51:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:51:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:51:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.1796037070000001, 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:51:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:51:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.1765882199999993, 2024-09-12T21:51:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:51:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:51:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3202259520000004, 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:51:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:51:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3196951019999998, 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:51:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:51:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:51:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:51:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:51:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:51:57.828 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:51:57.829 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:57.828+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:57.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:57.929 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:57.929+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:57.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:51:57.973 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:51:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:51:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:146175 5.6 5:669051fe:::benchmark_data_smithi053_32461_object146174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T21:51:57.973 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.966897+0000", 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.006133342, 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0061526610000000002, 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 146175 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.966897+0000", 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.966897+0000", 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.966898+0000", 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5300000000000003e-07 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.966981+0000", 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2986999999999997e-05 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.966998+0000", 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7159e-05 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.967003+0000", 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1329999999999998e-06 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.967051+0000", 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7618999999999999e-05 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.967172+0000", 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120753 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.967315+0000", 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014337900000000001 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.970699+0000", 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033842350000000002 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:146184 5.a e48/36 5:5bebb5e9:::benchmark_data_smithi053_32461_object146183:head v 48'8976, mlcod=48'8974)", 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.971421+0000", 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001609777, 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0016773160000000001, 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971421+0000", 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971421+0000", 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971421+0000", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971480+0000", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9268999999999998e-05 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971490+0000", 2024-09-12T21:51:57.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7569999999999999e-06 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971499+0000", 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5029999999999997e-06 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971546+0000", 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7372e-05 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.971568+0000", 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1608e-05 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:146183 5.3 e48/21 5:c166d5d1:::benchmark_data_smithi053_32461_object146182:head v 48'9285, mlcod=48'9282)", 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.972462+0000", 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00056876099999999998, 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00067021699999999997, 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:51:57.983 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972462+0000", 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:51:57.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972462+0000", 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972462+0000", 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7400000000000003e-07 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972527+0000", 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4267e-05 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972539+0000", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2248e-05 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972546+0000", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0820000000000001e-06 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972579+0000", 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3028000000000003e-05 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:51:57.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.972590+0000", 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559999999999999e-05 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 3 2024-09-12T21:51:57.987 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:51:57.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:58.030 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:58.029+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:58.064 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:51:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:51:58.083 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:51:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:51:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:51:58.088 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:51:58.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:51:58.131 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.131+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:58.177 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:58.177 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:58.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:58.233 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:58.231+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:58.333 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.332+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:58.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 59 16 147086 147070 155.78 143.188 0.00642416 0.00641678 2024-09-12T21:51:58.375 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:58.375 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:58.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:58.434 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.433+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:58.535 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.534+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:58.539 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:58.539 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:58.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:58.636 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:58.635+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:58.702 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:58.703 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:58.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:58.736 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.736+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:58.837 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:58.837+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:58.920 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:58.920 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:58.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:58.977 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:58.977+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.039 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:59.038+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.077 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.078 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:59.140 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:59.139+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:59.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-09-12T21:51:59.241 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:59.240+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:51:59.342 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:59.342+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.359 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:2024-09-12T21:51:59.359648+0000 min lat: 0.00117781 max lat: 1.16496 avg lat: 0.00642755 2024-09-12T21:51:59.360 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T21:51:59.360 INFO:tasks.radosbench.radosbench.0.smithi053.stdout: 60 2 149313 149311 155.518 140.062 0.00722318 0.00642755 2024-09-12T21:51:59.406 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.406 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:51:59.457 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:59.457+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:51:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.531 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:51:59.587 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:59.585+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:59.646 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:59.645+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.654 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.654 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:51:59.751 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:59.750+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:51:59.814 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.814 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:51:59.867 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:51:59.867+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:51:59.935 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:51:59.935 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:51:59.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:51:59.948 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:51:59.948+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.049 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:00.048+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:00.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:00.096 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:00.096 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:00.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:00.189 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:00.189+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:00.214 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:00.214 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:00.231 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:00.235 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:00.235 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:00.251 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:00.250+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.261 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:00.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.927016238, 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.262 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:52:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.92674367, 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:52:00.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:52:00.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.926685745, 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.274 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:52:00.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:52:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:52:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:52:00.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:00.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.925613775999999, 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:52:00.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:52:00.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.922065195000002, 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:52:00.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:52:00.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.920748041000003, 2024-09-12T21:52:00.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:52:00.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.920393965999999, 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:52:00.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:52:00.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.919786135999999, 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:52:00.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.919766694000003, 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.310 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:52:00.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:00.314 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 47.919060201000001, 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:52:00.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.113346278999998, 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.319 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:00.320 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.321 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.322 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:52:00.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.949540102999997, 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.325 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:00.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.329 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.947918708000003, 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.331 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:00.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.947828678999997, 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.337 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:00.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.944656977999998, 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.343 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:00.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:00.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:00.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.944136723, 2024-09-12T21:52:00.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:00.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:00.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:00.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.937553237000003, 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:00.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:00.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:00.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:00.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.924943425000002, 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:00.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:00.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:00.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:00.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.247007533000001, 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:52:00.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:52:00.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:146091 5.7 5:ebd38b94:::benchmark_data_smithi053_32461_object146090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 2.3335102179999998, 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023694130000000001, 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 146091 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.374 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925862+0000", 2024-09-12T21:52:00.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925915+0000", 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3112000000000002e-05 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925939+0000", 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3994000000000001e-05 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925948+0000", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7520000000000002e-06 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933227+0000", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072793119999999996 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933355+0000", 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012708700000000001 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933521+0000", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000166324 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.941466+0000", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079454120000000007 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949467+0000", 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080007069999999993 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949517+0000", 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0149999999999999e-05 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949555+0000", 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8327000000000001e-05 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:00.379 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Total time run: 60.0058 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Total writes made: 149313 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Write size: 65536 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Object size: 65536 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Bandwidth (MB/sec): 155.519 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Stddev Bandwidth: 47.8382 2024-09-12T21:52:00.381 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Max bandwidth (MB/sec): 322.625 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Min bandwidth (MB/sec): 0 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Average IOPS: 2488 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Stddev IOPS: 765.411 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Max IOPS: 5162 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Min IOPS: 0 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Average Latency(s): 0.00642755 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Stddev Latency(s): 0.0159199 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Max latency(s): 1.16496 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Min latency(s): 0.00117781 2024-09-12T21:52:00.382 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Cleaning up (deleting benchmark objects) 2024-09-12T21:52:00.383 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:00.383 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:00.380+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.482 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:00.481+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.486 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149736 5.2 5:45069563:::benchmark_data_smithi053_32461_object420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.523357+0000", 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093974100000000001, 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094143270000000001, 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149736 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523357+0000", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523357+0000", 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523358+0000", 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523361+0000", 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8600000000000003e-06 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523373+0000", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.117e-05 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523379+0000", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8009999999999998e-06 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.525756+0000", 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023760610000000001 2024-09-12T21:52:00.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.525824+0000", 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8281999999999994e-05 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.525933+0000", 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109138 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532298+0000", 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063648469999999999 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149739 5.2 5:49298b7c:::benchmark_data_smithi053_32461_object423:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.523655+0000", 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090992350000000007, 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092053959999999994, 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:00.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149739 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523655+0000", 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523655+0000", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523656+0000", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000002e-07 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523659+0000", 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8959999999999999e-06 2024-09-12T21:52:00.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523667+0000", 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6160000000000002e-06 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523673+0000", 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1029999999999998e-06 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527431+0000", 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00375808 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527609+0000", 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000177665 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527712+0000", 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102898 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532304+0000", 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045917240000000002 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149740 5.a 5:57a19fdf:::benchmark_data_smithi053_32461_object424:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.523683+0000", 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090715110000000009, 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092503459999999996, 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149740 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523683+0000", 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523683+0000", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523683+0000", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6699999999999999e-07 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523685+0000", 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.68e-06 2024-09-12T21:52:00.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523691+0000", 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.677e-06 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.523695+0000", 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4619999999999998e-06 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.529540+0000", 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058445600000000004 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.529631+0000", 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1003999999999998e-05 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.529699+0000", 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8388999999999999e-05 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149743 5.a 5:5bd52713:::benchmark_data_smithi053_32461_object427:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.526076+0000", 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066783049999999998, 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006896592, 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149743 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526076+0000", 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526076+0000", 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526077+0000", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7700000000000003e-07 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526080+0000", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9009999999999998e-06 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526088+0000", 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4570000000000005e-06 2024-09-12T21:52:00.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526094+0000", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5589999999999996e-06 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532304+0000", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062105440000000001 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532389+0000", 2024-09-12T21:52:00.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5142999999999994e-05 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532463+0000", 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3936000000000005e-05 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149748 5.c 5:33506be8:::benchmark_data_smithi053_32461_object432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.526983+0000", 2024-09-12T21:52:00.553 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057712190000000002, 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060265309999999999, 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149748 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526983+0000", 2024-09-12T21:52:00.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526983+0000", 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526984+0000", 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6400000000000001e-07 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526988+0000", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.526998+0000", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0149000000000001e-05 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527004+0000", 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.071e-06 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527050+0000", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5339000000000001e-05 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527158+0000", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010870900000000001 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.527259+0000", 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100938 2024-09-12T21:52:00.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.529206+0000", 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001946815 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149751 5.a 5.8435788a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.528079+0000", 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046751320000000002, 2024-09-12T21:52:00.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049685720000000001, 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149751 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528079+0000", 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528079+0000", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528080+0000", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528083+0000", 2024-09-12T21:52:00.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3139999999999999e-06 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528091+0000", 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5530000000000004e-06 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528096+0000", 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5400000000000003e-06 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149752 5.2 5.5e705762 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.528558+0000", 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041966690000000001, 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045167150000000001, 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149752 2024-09-12T21:52:00.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528558+0000", 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528558+0000", 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528558+0000", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7000000000000004e-07 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528563+0000", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2309999999999998e-06 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528572+0000", 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.064e-06 2024-09-12T21:52:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.528578+0000", 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.195e-06 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:149759 5.4 5:2dc1f7cd:::benchmark_data_smithi053_32461_object443:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.531870+0000", 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00088463799999999998, 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234143, 2024-09-12T21:52:00.565 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 149759 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531870+0000", 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531870+0000", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531871+0000", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.003e-06 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531875+0000", 2024-09-12T21:52:00.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1919999999999998e-06 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531885+0000", 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0214000000000001e-05 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531892+0000", 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2429999999999999e-06 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.531938+0000", 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5240000000000001e-05 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532015+0000", 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7729000000000001e-05 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:149758 5.1 e49/36 5:8dd2ca58:::benchmark_data_smithi053_32461_object442:head v 49'9318, mlcod=49'9315)", 2024-09-12T21:52:00.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.532087+0000", 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00066767599999999997, 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010499769999999999, 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532087+0000", 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532087+0000", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532087+0000", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532092+0000", 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2410000000000003e-06 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532100+0000", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9740000000000002e-06 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532107+0000", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2219999999999999e-06 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532148+0000", 2024-09-12T21:52:00.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1668999999999997e-05 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532169+0000", 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0809e-05 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:149760 5.7 e49/21 5:ed3d649f:::benchmark_data_smithi053_32461_object444:head v 49'9355, mlcod=49'9353)", 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:00.532764+0000", 2024-09-12T21:52:00.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999905, 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000403242, 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532764+0000", 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532764+0000", 2024-09-12T21:52:00.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532764+0000", 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9699999999999996e-07 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532769+0000", 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7530000000000001e-06 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532780+0000", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0481e-05 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532785+0000", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4859999999999997e-06 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532831+0000", 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5899999999999998e-05 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:00.532850+0000", 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8672e-05 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-09-12T21:52:00.577 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:00.578 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:00.582 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:00.582+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:00.684 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:00.683+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.768 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:00.768 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:00.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:00.822 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:00.821+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:00.885 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:00.885+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:00.975 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.632273756000004, 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:00.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.630952229999998, 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:00.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:00.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.630464387000004, 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.629737005999999, 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.623942448999998, 2024-09-12T21:52:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:52:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.662892954999997, 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.662765495999999, 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.662706876000001, 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.660595229999998, 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.658938288000002, 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.657988689, 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.653764602000003, 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.651411064000001, 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.649787871999997, 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:52:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.881093273000001, 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:52:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.75648694, 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:52:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:52:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.458241692, 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:52:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.455226205000001, 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:52:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.598863937, 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:52:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:52:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:52:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.5983330870000003, 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:52:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.112 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:01.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:01.114 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:01.113+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:01.215 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:01.214+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:151775 5.5 e49/21 5:a3436560:::benchmark_data_smithi053_32461_object2459:head v 49'9417, mlcod=49'9413)", 2024-09-12T21:52:01.261 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.253920+0000", 2024-09-12T21:52:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0046371959999999997, 2024-09-12T21:52:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046544500000000001, 2024-09-12T21:52:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253920+0000", 2024-09-12T21:52:01.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253920+0000", 2024-09-12T21:52:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253920+0000", 2024-09-12T21:52:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8599999999999998e-07 2024-09-12T21:52:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253925+0000", 2024-09-12T21:52:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6160000000000004e-06 2024-09-12T21:52:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253933+0000", 2024-09-12T21:52:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8820000000000001e-06 2024-09-12T21:52:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.253938+0000", 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5010000000000004e-06 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.254001+0000", 2024-09-12T21:52:01.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2416999999999995e-05 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.254018+0000", 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7159999999999998e-05 2024-09-12T21:52:01.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151781 5.1 5:84b1e1db:::benchmark_data_smithi053_32461_object2465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.255800+0000", 2024-09-12T21:52:01.271 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002757364, 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028350010000000002, 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.272 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151781 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255800+0000", 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255800+0000", 2024-09-12T21:52:01.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255800+0000", 2024-09-12T21:52:01.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9100000000000003e-07 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255805+0000", 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2869999999999998e-06 2024-09-12T21:52:01.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255812+0000", 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.922e-06 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255817+0000", 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9109999999999998e-06 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.255869+0000", 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1319000000000001e-05 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256025+0000", 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000155988 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256142+0000", 2024-09-12T21:52:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117324 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:151780 5.2 e49/36 5:45171adb:::benchmark_data_smithi053_32461_object2464:head v 49'9315, mlcod=49'9312)", 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.256205+0000", 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023516230000000002, 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025021850000000001, 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256205+0000", 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256205+0000", 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256206+0000", 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2000000000000001e-07 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256209+0000", 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6320000000000001e-06 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256217+0000", 2024-09-12T21:52:01.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2450000000000001e-06 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256222+0000", 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2340000000000002e-06 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256265+0000", 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3229999999999998e-05 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256285+0000", 2024-09-12T21:52:01.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9797e-05 2024-09-12T21:52:01.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.289 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151785 5.f 5:fbe78f3c:::benchmark_data_smithi053_32461_object2469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.256238+0000", 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002318933, 2024-09-12T21:52:01.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025232259999999999, 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151785 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256238+0000", 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256238+0000", 2024-09-12T21:52:01.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256239+0000", 2024-09-12T21:52:01.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6599999999999996e-07 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256241+0000", 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6450000000000001e-06 2024-09-12T21:52:01.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256249+0000", 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.469e-06 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256255+0000", 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6559999999999997e-06 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256303+0000", 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8925000000000003e-05 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256440+0000", 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013677399999999999 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151786 5.d 5:b6b62460:::benchmark_data_smithi053_32461_object2470:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.256306+0000", 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0022514169999999999, 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025196910000000001, 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151786 2024-09-12T21:52:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256306+0000", 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256306+0000", 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256306+0000", 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256308+0000", 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0499999999999999e-06 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256313+0000", 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3879999999999999e-06 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256317+0000", 2024-09-12T21:52:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8530000000000002e-06 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256355+0000", 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7524000000000002e-05 2024-09-12T21:52:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256448+0000", 2024-09-12T21:52:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3523999999999994e-05 2024-09-12T21:52:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.310 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151788 5.9 5:9a9de99b:::benchmark_data_smithi053_32461_object2472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.310 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.256413+0000", 2024-09-12T21:52:01.310 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021443080000000002, 2024-09-12T21:52:01.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024745040000000002, 2024-09-12T21:52:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.311 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151788 2024-09-12T21:52:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256413+0000", 2024-09-12T21:52:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256413+0000", 2024-09-12T21:52:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256414+0000", 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4200000000000005e-07 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256416+0000", 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7810000000000001e-06 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256424+0000", 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4989999999999997e-06 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256436+0000", 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2048000000000001e-05 2024-09-12T21:52:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256478+0000", 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2307e-05 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.319 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.319 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256584+0000", 2024-09-12T21:52:01.319 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010609 2024-09-12T21:52:01.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.320 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.320 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.321 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151789 5.9 5:9a62bb29:::benchmark_data_smithi053_32461_object2473:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.321 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.256455+0000", 2024-09-12T21:52:01.321 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021021579999999998, 2024-09-12T21:52:01.321 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024969530000000001, 2024-09-12T21:52:01.321 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.322 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.322 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.322 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151789 2024-09-12T21:52:01.323 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.323 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.323 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.324 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.324 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256455+0000", 2024-09-12T21:52:01.324 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.324 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.325 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.325 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256455+0000", 2024-09-12T21:52:01.325 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.326 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.326 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.326 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256455+0000", 2024-09-12T21:52:01.326 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256458+0000", 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5739999999999998e-06 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256466+0000", 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7400000000000004e-06 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.327 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.256471+0000", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6609999999999997e-06 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258407+0000", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001935146 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258524+0000", 2024-09-12T21:52:01.328 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011702 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151792 5.9 5.4e8950a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.257925+0000", 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00063189099999999998, 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010816599999999999, 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:01.329 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151792 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257925+0000", 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257925+0000", 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257926+0000", 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9999999999999995e-07 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257930+0000", 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3139999999999997e-06 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.331 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257940+0000", 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9240000000000002e-06 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.257947+0000", 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9600000000000003e-06 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.332 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:151782 5.a e49/36 5:564ccca8:::benchmark_data_smithi053_32461_object2466:head v 49'9345, mlcod=49'9343)", 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.258184+0000", 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00037250500000000003, 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00085145000000000001, 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258184+0000", 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.333 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258184+0000", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258185+0000", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8800000000000003e-07 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258189+0000", 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9650000000000002e-06 2024-09-12T21:52:01.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258195+0000", 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.477e-06 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258199+0000", 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6780000000000002e-06 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.335 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258246+0000", 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7068999999999999e-05 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258270+0000", 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:151781 5.1 e49/36)", 2024-09-12T21:52:01.336 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.258939+0000", 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9996176, 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012557900000000001, 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258939+0000", 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.337 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258939+0000", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258940+0000", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258943+0000", 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5469999999999999e-06 2024-09-12T21:52:01.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258949+0000", 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8190000000000003e-06 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258953+0000", 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9829999999999998e-06 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:151794 5.9 5.8f758bd9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:01.258976+0000", 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9995813, 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011411700000000001, 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 151794 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258976+0000", 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258976+0000", 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.341 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258976+0000", 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0900000000000002e-07 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258979+0000", 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6369999999999999e-06 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258985+0000", 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3849999999999999e-06 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:01.258989+0000", 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4769999999999999e-06 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 11 2024-09-12T21:52:01.343 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:01.344 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:01.343+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:01.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:01.445 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:01.444+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:01.537 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:01.537 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:01.537 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:01.537 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:01.537 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:01.545 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:01.544+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:01.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:01.647 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:01.646+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:01.702 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:01.702 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:01.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:01.702 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.366655868000002, 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:52:01.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:52:01.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:52:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.366383300000003, 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:52:01.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.366325375000002, 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:52:01.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.723 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.365253406000001, 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.724 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:52:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:52:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.730 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.361704824999997, 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.731 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:01.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:52:01.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.360387670999998, 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:52:01.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:52:01.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:01.743 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.360033596000001, 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:01.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:52:01.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.747 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.359425766000001, 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:52:01.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:52:01.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.359406323999998, 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.752 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:52:01.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:52:01.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 49.358699831000003, 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:52:01.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:52:01.761 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.552985909, 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:52:01.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:52:01.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.389179732999999, 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.768 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:01.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:01.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.387558337999998, 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:01.774 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:01.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:01.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.387468308999999, 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:01.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:01.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.384296608, 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.787 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:01.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.383776353000002, 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.794 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.377192866999998, 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:01.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:01.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:01.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:01.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 40.364583054999997, 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:01.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:01.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.686647163, 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.814 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:01.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:52:01.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.819 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:146091 5.7 5:ebd38b94:::benchmark_data_smithi053_32461_object146090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.7731498480000001, 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023694130000000001, 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.820 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 146091 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:01.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925862+0000", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925915+0000", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3112000000000002e-05 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925939+0000", 2024-09-12T21:52:01.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3994000000000001e-05 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925948+0000", 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7520000000000002e-06 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933227+0000", 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072793119999999996 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933355+0000", 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012708700000000001 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933521+0000", 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000166324 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.941466+0000", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079454120000000007 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949467+0000", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080007069999999993 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949517+0000", 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0149999999999999e-05 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949555+0000", 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8327000000000001e-05 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:01.826 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:01.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:01.828 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:01.827+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:01.928 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:01.927+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153959 5.a 5:53a0e217:::benchmark_data_smithi053_32461_object4643:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982284+0000", 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024108089999999999, 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024397989999999999, 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153959 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982284+0000", 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982284+0000", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982285+0000", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3099999999999997e-07 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982288+0000", 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8159999999999998e-06 2024-09-12T21:52:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982296+0000", 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349999999999999e-06 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982301+0000", 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.665e-06 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983415+0000", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001113548 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983552+0000", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013685800000000001 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983668+0000", 2024-09-12T21:52:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116016 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153960 5.c 5.8745022c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982326+0000", 2024-09-12T21:52:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023693659999999999, 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024697310000000002, 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153960 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982326+0000", 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982326+0000", 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982326+0000", 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0399999999999996e-07 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982329+0000", 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3039999999999999e-06 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982336+0000", 2024-09-12T21:52:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982342+0000", 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2439999999999998e-06 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153961 5.8 5:1d59c34f:::benchmark_data_smithi053_32461_object4645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982349+0000", 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023466110000000002, 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025000299999999999, 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153961 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982349+0000", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982349+0000", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982349+0000", 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5900000000000003e-07 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982351+0000", 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6339999999999999e-06 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982357+0000", 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6000000000000003e-06 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982363+0000", 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2989999999999996e-06 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982407+0000", 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4023999999999997e-05 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982530+0000", 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012337000000000001 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153962 5.5 5:a1222a4d:::benchmark_data_smithi053_32461_object4646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982371+0000", 2024-09-12T21:52:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023239480000000002, 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025417949999999999, 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153962 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982371+0000", 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982371+0000", 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982372+0000", 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6800000000000001e-07 2024-09-12T21:52:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982373+0000", 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7179999999999999e-06 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982380+0000", 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5819999999999998e-06 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982384+0000", 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.318e-06 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982428+0000", 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3603000000000002e-05 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982530+0000", 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101786 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982632+0000", 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010268999999999999 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984650+0000", 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002017937 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153963 5.2 5.a16d1642 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982400+0000", 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022955689999999999, 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025819039999999999, 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153963 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982400+0000", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982400+0000", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982400+0000", 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7399999999999999e-07 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982402+0000", 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8059999999999999e-06 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982408+0000", 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982412+0000", 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5079999999999999e-06 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:153958 5.1 e49/36 5:8d35d727:::benchmark_data_smithi053_32461_object4642:head v 49'9570, mlcod=49'9568)", 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982679+0000", 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020163379999999999, 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023516100000000001, 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982679+0000", 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982679+0000", 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982679+0000", 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982684+0000", 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7589999999999997e-06 2024-09-12T21:52:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982691+0000", 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0219999999999999e-06 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982698+0000", 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3380000000000001e-06 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982733+0000", 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5856999999999999e-05 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982750+0000", 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6572999999999999e-05 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153964 5.2 5.11b79b02 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.982917+0000", 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017782799999999999, 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021645789999999998, 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153964 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982917+0000", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982917+0000", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982918+0000", 2024-09-12T21:52:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2699999999999999e-07 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982920+0000", 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982928+0000", 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9559999999999997e-06 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982934+0000", 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8490000000000002e-06 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153966 5.0 5:0fb841f7:::benchmark_data_smithi053_32461_object4650:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.983315+0000", 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001380523, 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018160749999999999, 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153966 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983315+0000", 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983315+0000", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983315+0000", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3099999999999997e-07 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983319+0000", 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6090000000000001e-06 2024-09-12T21:52:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983328+0000", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4419999999999998e-06 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983334+0000", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0430000000000004e-06 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984102+0000", 2024-09-12T21:52:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00076812199999999999 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984221+0000", 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011929 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:153967 5.7 e49/21 5:eda040ba:::benchmark_data_smithi053_32461_object4651:head v 49'9636, mlcod=49'9634)", 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.983352+0000", 2024-09-12T21:52:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001343091, 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00183808, 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983352+0000", 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983352+0000", 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983353+0000", 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5699999999999998e-07 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983356+0000", 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3330000000000001e-06 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983362+0000", 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2670000000000003e-06 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983366+0000", 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2050000000000004e-06 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983410+0000", 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3705999999999998e-05 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983429+0000", 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8977000000000001e-05 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:153965 5.1 e49/36 5:87cc351e:::benchmark_data_smithi053_32461_object4649:head v 49'9571, mlcod=49'9568)", 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.984308+0000", 2024-09-12T21:52:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00038684199999999998, 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093828900000000003, 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984308+0000", 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984308+0000", 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984309+0000", 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7400000000000002e-07 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984314+0000", 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9130000000000002e-06 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984323+0000", 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0100000000000001e-06 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984329+0000", 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1349999999999997e-06 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984582+0000", 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025226300000000002 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984599+0000", 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7263000000000001e-05 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153968 5.5 5:aa36454c:::benchmark_data_smithi053_32461_object4652:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.984652+0000", 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3692000000000001e-05, 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065193100000000002, 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153968 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984652+0000", 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984652+0000", 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984652+0000", 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3600000000000002e-07 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984656+0000", 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5899999999999999e-06 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984665+0000", 2024-09-12T21:52:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0599999999999997e-06 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984671+0000", 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2840000000000003e-06 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984708+0000", 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6634000000000002e-05 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984823+0000", 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011486500000000001 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984923+0000", 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9852000000000006e-05 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153969 5.b 5:d2fcf2bc:::benchmark_data_smithi053_32461_object4653:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.984686+0000", 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4870000000000008e-06, 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068669900000000003, 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153969 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984686+0000", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984686+0000", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984686+0000", 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9900000000000001e-07 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984688+0000", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.181e-06 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984695+0000", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984700+0000", 2024-09-12T21:52:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1259999999999997e-06 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984745+0000", 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5015999999999997e-05 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.984875+0000", 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130087 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:153957 5.c e49/21)", 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.985210+0000", 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994855, 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021947700000000001, 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985210+0000", 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985210+0000", 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985211+0000", 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985214+0000", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8199999999999998e-06 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985223+0000", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1060000000000006e-06 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.985230+0000", 2024-09-12T21:52:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.686e-06 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153954 5.4 5:2f991a4a:::benchmark_data_smithi053_32461_object4638:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.979389+0000", 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053060190000000004, 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060891549999999997, 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153954 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979389+0000", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979389+0000", 2024-09-12T21:52:02.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979390+0000", 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979394+0000", 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7069999999999998e-06 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979403+0000", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4800000000000007e-06 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979410+0000", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3829999999999997e-06 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979464+0000", 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4305000000000003e-05 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979581+0000", 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116922 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153955 5.b 5:defb80a0:::benchmark_data_smithi053_32461_object4639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.979431+0000", 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052640669999999999, 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006110898, 2024-09-12T21:52:02.047 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153955 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979431+0000", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979431+0000", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979432+0000", 2024-09-12T21:52:02.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7899999999999999e-07 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979434+0000", 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5670000000000002e-06 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979441+0000", 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7000000000000002e-06 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979446+0000", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.882e-06 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982061+0000", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002615563 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982133+0000", 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1289000000000001e-05 2024-09-12T21:52:02.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153956 5.4 5:2fd7db88:::benchmark_data_smithi053_32461_object4640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.979941+0000", 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047544559999999998, 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056559979999999998, 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153956 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979941+0000", 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979941+0000", 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979942+0000", 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3399999999999998e-07 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979945+0000", 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.45e-06 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979954+0000", 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9800000000000004e-06 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.979960+0000", 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7599999999999999e-06 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.981262+0000", 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001301817 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.981388+0000", 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012640500000000001 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:153957 5.c 5:3a6485f7:::benchmark_data_smithi053_32461_object4641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T21:52:02.056 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:01.980705+0000", 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003990352, 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049557919999999997, 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 153957 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980705+0000", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980705+0000", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980705+0000", 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2699999999999999e-07 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980708+0000", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.881e-06 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980716+0000", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5390000000000002e-06 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.980722+0000", 2024-09-12T21:52:02.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4219999999999997e-06 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.982823+0000", 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021003020000000001 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983042+0000", 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021893499999999999 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:02.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:01.983135+0000", 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3591000000000006e-05 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 17 2024-09-12T21:52:02.061 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:02.062 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.062+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:02.164 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.163+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:02.256 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:02.257 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:02.257 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:02.257 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:02.257 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:02.264 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.264+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:02.363 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:02.365 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.364+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.382 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:02.383 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:02.383 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:02.386 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:02.386 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:02.429 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:02.429 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:02.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:02.485 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.485+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:02.567 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.566+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.584 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:02.584 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:02.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:02.681 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.681+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.769 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:02.769+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:02.786 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:02.786 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:02.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:02.870 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:02.869+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:02.971 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:02.970+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:02.984 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:02.984 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:02.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:03.072 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.071+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:03.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:03.172 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.172+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:03.273 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:03.272+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:03.322 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:03.322 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:03.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:03.373 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.373+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:03.475 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:03.474+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:03.535 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:03.535 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:03.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:03.592 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.592+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:03.676 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.675+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:03.693 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:03.693 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:03.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:03.776 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:03.775+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:03.877 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:03.876+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:03.890 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:03.890 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:03.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:03.978 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:03.977+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:04.052 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:04.052 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:04.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:04.108 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.107+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.180 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.178+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.220 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:04.220 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:04.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:04.319 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.318+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.380 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.379+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:04.427 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:04.427 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:04.440 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:04.481 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:04.481+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:04.514 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:04.514 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:04.533 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:04.534 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:04.534 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:04.537 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:04.537 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:04.582 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.581+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.643 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:04.643 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.300290492000002, 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:04.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:04.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.298968965999997, 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:04.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.298481123000002, 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:04.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:04.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:04.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.297753741999998, 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:04.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:04.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.291959185000003, 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:52:04.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:52:04.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.330909691000002, 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:04.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.330782231999997, 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:04.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:04.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:04.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.330723612, 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:04.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.328611965999997, 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:04.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:04.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.326955024, 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:04.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:04.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:04.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.326005424999998, 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:04.707 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:04.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:04.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:04.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.714 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.321781338000001, 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:04.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.3194278, 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.317804608000003, 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.549110009, 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:52:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:52:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:52:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:52:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.424503676, 2024-09-12T21:52:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:52:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:52:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:52:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.126258428, 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:52:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:52:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:52:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:52:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.123242941000001, 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:52:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:52:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:52:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:52:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:52:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.266880672999999, 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:52:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.266349823000001, 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:52:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:52:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:04.789 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:04.791 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.789+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:04.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:04.891 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:04.890+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:04.947 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162762 5.1 5.287b521 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.945893+0000", 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00027940300000000001, 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00029904699999999998, 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162762 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945893+0000", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945893+0000", 2024-09-12T21:52:04.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945894+0000", 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945899+0000", 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4349999999999999e-06 2024-09-12T21:52:04.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945910+0000", 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0994e-05 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945917+0000", 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2250000000000003e-06 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162766 5.7 5:ef3fb1ce:::benchmark_data_smithi053_32461_object13450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.945935+0000", 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000237853, 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00032223400000000002, 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162766 2024-09-12T21:52:04.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945935+0000", 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945935+0000", 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945936+0000", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1600000000000001e-07 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945939+0000", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.92e-06 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945946+0000", 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8339999999999999e-06 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945965+0000", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.821e-05 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946009+0000", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4452000000000001e-05 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946119+0000", 2024-09-12T21:52:04.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109491 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946254+0000", 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013581699999999999 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162768 5.f 5:fc9c07b6:::benchmark_data_smithi053_32461_object13452:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.945982+0000", 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00019044600000000001, 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00034807700000000002, 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162768 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945982+0000", 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945982+0000", 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945983+0000", 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7000000000000005e-07 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945986+0000", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7709999999999998e-06 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945994+0000", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7010000000000002e-06 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946000+0000", 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.451e-06 2024-09-12T21:52:04.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946035+0000", 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5468e-05 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946150+0000", 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011506999999999999 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162769 5.1 5.d30bcad1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.946334+0000", 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998388, 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2228000000000001e-05, 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162769 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946334+0000", 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946334+0000", 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946334+0000", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1500000000000004e-07 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946337+0000", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5919999999999999e-06 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946346+0000", 2024-09-12T21:52:04.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3330000000000003e-06 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946352+0000", 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1959999999999999e-06 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162745 5.9 5:9fc3d7f6:::benchmark_data_smithi053_32461_object13429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.940000+0000", 2024-09-12T21:52:04.964 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0061726719999999997, 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006460917, 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162745 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940000+0000", 2024-09-12T21:52:04.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940000+0000", 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940001+0000", 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1600000000000001e-07 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940004+0000", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5250000000000001e-06 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940012+0000", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0260000000000007e-06 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.940018+0000", 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1830000000000002e-06 2024-09-12T21:52:04.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941815+0000", 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001797295 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941944+0000", 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000129398 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162749 5.1 5:897674cb:::benchmark_data_smithi053_32461_object13433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.941017+0000", 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0051556750000000002, 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0055096759999999998, 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162749 2024-09-12T21:52:04.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941017+0000", 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941017+0000", 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941018+0000", 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8500000000000001e-07 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941021+0000", 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.852e-06 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941029+0000", 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0420000000000003e-06 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941035+0000", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8760000000000002e-06 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941740+0000", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00070575 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941849+0000", 2024-09-12T21:52:04.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108572 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941951+0000", 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101779 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945852+0000", 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003901528 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162754 5.9 5:94119540:::benchmark_data_smithi053_32461_object13438:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.941332+0000", 2024-09-12T21:52:04.977 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0048413010000000001, 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.005272662, 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162754 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941332+0000", 2024-09-12T21:52:04.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941332+0000", 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941332+0000", 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8100000000000001e-07 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941337+0000", 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7400000000000004e-06 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941346+0000", 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3850000000000002e-06 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.941352+0000", 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5819999999999998e-06 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943888+0000", 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025356250000000001 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944010+0000", 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012254799999999999 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162757 5.1 5:8fdc0c77:::benchmark_data_smithi053_32461_object13441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.943436+0000", 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027368190000000001, 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003237073, 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162757 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943436+0000", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943436+0000", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943437+0000", 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2200000000000004e-07 2024-09-12T21:52:04.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943440+0000", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2179999999999999e-06 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943448+0000", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9310000000000008e-06 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943453+0000", 2024-09-12T21:52:04.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5489999999999997e-06 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943851+0000", 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00039718400000000002 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.943989+0000", 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013808399999999999 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944104+0000", 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011557000000000001 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945892+0000", 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001787975 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.986 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:162759 5.1 5:821e456c:::benchmark_data_smithi053_32461_object13443:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:04.944585+0000", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001587574, 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002163842, 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 162759 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:04.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944585+0000", 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944585+0000", 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944586+0000", 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2099999999999995e-07 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944593+0000", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944603+0000", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9299999999999998e-06 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.944609+0000", 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4309999999999999e-06 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.945922+0000", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001313261 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946042+0000", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120024 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:04.946156+0000", 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011353000000000001 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:04.991 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 9 2024-09-12T21:52:04.991 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:04.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:04.993 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:04.991+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-09-12T21:52:05.093 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.092+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.182 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:05.182 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:05.182 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:05.182 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:05.182 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:05.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:05.194 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.193+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.295 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.294+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.340 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.004997860000003, 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.341 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.342 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.344 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.346 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.004725292000003, 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.348 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:52:05.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:52:05.351 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.352 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.353 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.354 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.004667367000003, 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:52:05.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:52:05.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.361 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.003595398000002, 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:05.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:52:05.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.000046816999998, 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:52:05.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:52:05.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.998729662999999, 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.374 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:52:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:52:05.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:52:05.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.998375588000002, 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.381 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:52:05.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.386 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.997767758000002, 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:05.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.997748315999999, 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:52:05.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:52:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:52:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.997041823000004, 2024-09-12T21:52:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:52:05.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.191327901000001, 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.400 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:05.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:52:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.027521725, 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:05.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:05.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.025900329999999, 2024-09-12T21:52:05.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:05.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:05.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:05.420 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.025810301, 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:05.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:05.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:05.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.022638600000001, 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.428 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:05.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:05.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.022118345000003, 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.434 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:05.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:05.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:05.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.015534858999999, 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.440 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:05.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:05.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:05.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.002925046999998, 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.446 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:05.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.452 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.324989154999997, 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.453 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:52:05.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:146091 5.7 5:ebd38b94:::benchmark_data_smithi053_32461_object146090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:05.460 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 7.4114918400000001, 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023694130000000001, 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 146091 2024-09-12T21:52:05.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:05.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925862+0000", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925915+0000", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3112000000000002e-05 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925939+0000", 2024-09-12T21:52:05.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3994000000000001e-05 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925948+0000", 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7520000000000002e-06 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933227+0000", 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072793119999999996 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933355+0000", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012708700000000001 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933521+0000", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000166324 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.941466+0000", 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079454120000000007 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949467+0000", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080007069999999993 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949517+0000", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0149999999999999e-05 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949555+0000", 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8327000000000001e-05 2024-09-12T21:52:05.466 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:05.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:05.467 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:05.468 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.467+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:05.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:52:05.569 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.567+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:164821 5.3 5:c89afdcf:::benchmark_data_smithi053_32461_object15505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:05.607408+0000", 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001794272, 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018174059999999999, 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164821 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607408+0000", 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607408+0000", 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607409+0000", 2024-09-12T21:52:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000005e-07 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607413+0000", 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9210000000000002e-06 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607425+0000", 2024-09-12T21:52:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1637999999999999e-05 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607432+0000", 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.968e-06 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607478+0000", 2024-09-12T21:52:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6455999999999997e-05 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607590+0000", 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011203400000000001 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:05.607696+0000", 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105047 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-12T21:52:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:05.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:05.670 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:05.669+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:05.762 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:05.762 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:05.762 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:05.762 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:05.762 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:05.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:05.771 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.770+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.872 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.871+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.532989458999999, 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.531667933000001, 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.531180089999999, 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.530452709000002, 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.524658152000001, 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:52:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.563608658, 2024-09-12T21:52:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.563481199000002, 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.563422578999997, 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.561310933000001, 2024-09-12T21:52:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.559653990999998, 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.558704392000003, 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.554480304999998, 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.552126766999997, 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.550503575, 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.781808976000001, 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.657202643000002, 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:52:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:52:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.358957395000001, 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:52:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.355941907999998, 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:52:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:52:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:52:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.49957964, 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:52:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.49904879, 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:52:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:52:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:05.989 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:05.990 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:05.989+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:05.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:06.091 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:06.090+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5.b8d0318a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:06.107 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.56319432000000003, 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.56321812500000001, 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:06.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5.e84c204a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.53156756500000002, 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.53163422900000001, 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.115 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5.82c63bfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.51270805699999999, 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.51280985999999995, 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.116 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:06.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.119 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5.96c07e6a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.57478164499999995, 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.57493209300000003, 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.120 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164833 5.a 5.e0c12f4a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.617694+0000", 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48833723499999998, 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.48852026300000001, 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164833 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617694+0000", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617694+0000", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617695+0000", 2024-09-12T21:52:06.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9199999999999999e-07 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617699+0000", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0620000000000002e-06 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617710+0000", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0862999999999999e-05 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617716+0000", 2024-09-12T21:52:06.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1750000000000002e-06 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617758+0000", 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1885999999999998e-05 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.617764+0000", 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.48e-06 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5.45b5a8da (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.58595493099999996, 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.58616968899999999, 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.128 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:06.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5.dad6456a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.50791403199999996, 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.50816040500000004, 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.132 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:06.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5.5250127a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.59835722999999996, 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.59863649799999996, 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.136 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:06.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:06.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164836 5.a 5.1714e52a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.620804+0000", 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.48522738500000001, 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.485538211, 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.140 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164836 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620804+0000", 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620804+0000", 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620805+0000", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5300000000000003e-07 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620809+0000", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0690000000000003e-06 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620817+0000", 2024-09-12T21:52:06.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3839999999999997e-06 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620824+0000", 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5849999999999996e-06 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620871+0000", 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6830999999999999e-05 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.620877+0000", 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0109999999999997e-06 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5.c5beee5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.50660988699999998, 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.50695275900000003, 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.144 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.147 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5.ab32d85a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.59580646699999995, 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.59618101199999995, 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:06.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5.4182e3ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.570988367, 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.57140187200000003, 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.152 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.154 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164845 5.a 5.882755aa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.636769+0000", 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.46926197400000003, 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.46971178699999999, 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.156 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164845 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636769+0000", 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636769+0000", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636771+0000", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9800000000000001e-06 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636782+0000", 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0117e-05 2024-09-12T21:52:06.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636810+0000", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8632e-05 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636830+0000", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9449999999999998e-05 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636950+0000", 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119992 2024-09-12T21:52:06.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.636955+0000", 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0170000000000004e-06 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5.4a9ee9da (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.59323077999999996, 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.59371342800000004, 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5.7073b78a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.59104355799999997, 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.59156125100000001, 2024-09-12T21:52:06.164 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:06.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5.e615de6a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.49665715199999999, 2024-09-12T21:52:06.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.49720618500000002, 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for peered", 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 16 2024-09-12T21:52:06.172 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:06.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:06.215 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:06.214+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:06.293 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:06.293+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:06.320 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:06.320 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:06.320 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:06.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:06.394 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:06.393+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44629 5.7 5:e2f07a73:::benchmark_data_smithi053_32461_object44628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.139315578000001, 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069281920999999996, 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.474 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44629 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332355+0000", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332356+0000", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.012e-06 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332382+0000", 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5508999999999999e-05 2024-09-12T21:52:06.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332392+0000", 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0188e-05 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332402+0000", 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0091e-05 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332446+0000", 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3643999999999998e-05 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332531+0000", 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5061000000000004e-05 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332669+0000", 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013825799999999999 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337192+0000", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045230569999999996 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401567+0000", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064374823999999997 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401601+0000", 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3883000000000001e-05 2024-09-12T21:52:06.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401637+0000", 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6393999999999997e-05 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44631 5.7 5:e2f36e51:::benchmark_data_smithi053_32461_object44630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.139043010000002, 2024-09-12T21:52:06.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069142100999999997, 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44631 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332628+0000", 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1099999999999995e-07 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332659+0000", 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0445000000000001e-05 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332667+0000", 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4400000000000005e-06 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332676+0000", 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3799999999999994e-06 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333851+0000", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011753289999999999 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333919+0000", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8082000000000003e-05 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333991+0000", 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1768999999999997e-05 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337195+0000", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032036040000000001 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401692+0000", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064497172000000005 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401739+0000", 2024-09-12T21:52:06.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7184000000000001e-05 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401770+0000", 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1084999999999998e-05 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44632 5.7 5:e9130d29:::benchmark_data_smithi053_32461_object44631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.138985085000002, 2024-09-12T21:52:06.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.069213363999999999, 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44632 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332686+0000", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332711+0000", 2024-09-12T21:52:06.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4712e-05 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332718+0000", 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5289999999999997e-06 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.332721+0000", 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.117e-06 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335093+0000", 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023719890000000001 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335269+0000", 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017577700000000001 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335355+0000", 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6558999999999996e-05 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401646+0000", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066290616999999996 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401822+0000", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00017648800000000001 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401870+0000", 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7459000000000001e-05 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401899+0000", 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9505e-05 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44635 5.f 5:ff81bc2c:::benchmark_data_smithi053_32461_object44634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.137913116, 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.067952958999999993, 2024-09-12T21:52:06.492 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44635 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333758+0000", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333759+0000", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333860+0000", 2024-09-12T21:52:06.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101591 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333869+0000", 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3379999999999994e-06 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.333878+0000", 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0679999999999997e-06 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335768+0000", 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001890833 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335883+0000", 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114787 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.335993+0000", 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109379 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401554+0000", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065561452000000006 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401649+0000", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4909999999999998e-05 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401678+0000", 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8918e-05 2024-09-12T21:52:06.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401711+0000", 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2885000000000001e-05 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44643 5.2 5:4c71cb2b:::benchmark_data_smithi053_32461_object44642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.134364535000003, 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.064309668, 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.498 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44643 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337306+0000", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337307+0000", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8400000000000002e-07 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337419+0000", 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111795 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337426+0000", 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6800000000000004e-06 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337437+0000", 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0740000000000001e-05 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337471+0000", 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4715999999999998e-05 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337541+0000", 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0024999999999994e-05 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.337611+0000", 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0148000000000007e-05 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339064+0000", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014521849999999999 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401527+0000", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062463747999999999 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401579+0000", 2024-09-12T21:52:06.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1746999999999998e-05 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401616+0000", 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6900000000000002e-05 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:44644 5.f 5:fe750931:::benchmark_data_smithi053_32461_object44643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:06.504 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.133047380999997, 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.066562582999999995, 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 44644 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338623+0000", 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338624+0000", 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6000000000000004e-07 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338689+0000", 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4832000000000005e-05 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338695+0000", 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0349999999999998e-06 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338699+0000", 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9729999999999999e-06 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338734+0000", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4894999999999997e-05 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338807+0000", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2824000000000006e-05 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338884+0000", 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7634999999999998e-05 2024-09-12T21:52:06.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401808+0000", 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062923993999999997 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405092+0000", 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032834819999999999 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405142+0000", 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0299000000000001e-05 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405186+0000", 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4054000000000002e-05 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44635 5.f e30/21 ondisk, result = 0)", 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:06.510 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.132693306, 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062583806000000006, 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:06.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338978+0000", 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338981+0000", 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6240000000000002e-06 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338986+0000", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7440000000000004e-06 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.338991+0000", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.104e-06 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401542+0000", 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062551628999999997 2024-09-12T21:52:06.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401549+0000", 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401561+0000", 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2807e-05 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.514 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44629 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.132085476, 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062127884000000001, 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339585+0000", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339586+0000", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2399999999999998e-07 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339589+0000", 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6819999999999999e-06 2024-09-12T21:52:06.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339594+0000", 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1100000000000002e-06 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339597+0000", 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5980000000000001e-06 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401559+0000", 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061961623 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401563+0000", 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.532e-06 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401713+0000", 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000149815 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:44631 5.7 e30/21 ondisk, result = 0)", 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.132066033999998, 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062171835000000002, 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339605+0000", 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3300000000000001e-07 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339606+0000", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1620000000000001e-06 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339609+0000", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.225e-06 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.339612+0000", 2024-09-12T21:52:06.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.26e-06 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401680+0000", 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.062068233 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401686+0000", 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6320000000000002e-06 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401777+0000", 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0190000000000002e-05 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:44647 5.d e30/21 5:ba680df5:::benchmark_data_smithi053_32461_object44646:head v 30'2821, mlcod=30'2819)", 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 54.131359541000002, 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.065690079999999998, 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.523 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340311+0000", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340312+0000", 2024-09-12T21:52:06.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.340373+0000", 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1353999999999996e-05 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401397+0000", 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.061023723000000002 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401405+0000", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0520000000000002e-06 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401459+0000", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3862e-05 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.401479+0000", 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.969e-05 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.405970+0000", 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044918529999999996 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:12.406001+0000", 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0925e-05 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66246 5.f 5:f0505b8e:::benchmark_data_smithi053_32461_object66245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T21:52:06.527 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.325645618999999, 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.025748554999999999, 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66246 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146025+0000", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146026+0000", 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7399999999999998e-07 2024-09-12T21:52:06.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146048+0000", 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1985e-05 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146053+0000", 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6879999999999996e-06 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146057+0000", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4350000000000001e-06 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146112+0000", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5634999999999998e-05 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146232+0000", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011968099999999999 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 2", 2024-09-12T21:52:06.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.146367+0000", 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000134575 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.150214+0000", 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038477099999999998 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171712+0000", 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.021497160000000001 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171743+0000", 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1322999999999998e-05 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.171774+0000", 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0889000000000002e-05 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.533 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.161839442999998, 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:06.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.160218047999997, 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:06.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:06.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:06.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:06.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.160128018999998, 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:06.545 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:06.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.156956317999999, 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.551 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:06.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.156436063000001, 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:06.556 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:06.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:06.561 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.149852576999997, 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.562 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:06.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:06.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.567 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 45.137242765000003, 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.573 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:84410 5.7 5:ed9d657c:::benchmark_data_smithi053_32461_object84409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 35.459306873000003, 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023786578999999999, 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 84410 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012364+0000", 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8100000000000003e-07 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012391+0000", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6627000000000001e-05 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012398+0000", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9419999999999998e-06 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.012403+0000", 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1229999999999999e-06 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020785+0000", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083819459999999995 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.020911+0000", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012547 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.021055+0000", 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014436399999999999 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.023752+0000", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026973600000000002 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036045+0000", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.012292848 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036108+0000", 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3322000000000001e-05 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:31.036151+0000", 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2095999999999998e-05 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:146091 5.7 5:ebd38b94:::benchmark_data_smithi053_32461_object146090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.5458095580000002, 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.023694130000000001, 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:06.579 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 146091 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925861+0000", 2024-09-12T21:52:06.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925862+0000", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5300000000000002e-07 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925915+0000", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3112000000000002e-05 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925939+0000", 2024-09-12T21:52:06.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3994000000000001e-05 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.925948+0000", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7520000000000002e-06 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933227+0000", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0072793119999999996 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933355+0000", 2024-09-12T21:52:06.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012708700000000001 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.933521+0000", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000166324 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.941466+0000", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079454120000000007 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949467+0000", 2024-09-12T21:52:06.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080007069999999993 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949517+0000", 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0149999999999999e-05 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:57.949555+0000", 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8327000000000001e-05 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:06.584 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:06.585 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:06.585 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:06.586 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:06.585+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:06.587 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:52:06.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:06.686 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:06.686+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:06.748 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:06.748 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:165504 5.a e52/51 5:56fd24f8:::benchmark_data_smithi053_32461_object16188:head v 52'10199, mlcod=52'10195)", 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.741174+0000", 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061511550000000002, 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061703280000000001, 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741174+0000", 2024-09-12T21:52:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741174+0000", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741174+0000", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-07 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741178+0000", 2024-09-12T21:52:06.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.822e-06 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741183+0000", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3589999999999999e-06 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741187+0000", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9179999999999996e-06 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741237+0000", 2024-09-12T21:52:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9889000000000003e-05 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741256+0000", 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8779000000000001e-05 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:165509 5.6 e52/36 5:699b27f3:::benchmark_data_smithi053_32461_object16193:head v 52'10400, mlcod=52'10397)", 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.741215+0000", 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006109995, 2024-09-12T21:52:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061654800000000001, 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741215+0000", 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741215+0000", 2024-09-12T21:52:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741215+0000", 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.15e-07 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741219+0000", 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1119999999999998e-06 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741226+0000", 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9639999999999997e-06 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741231+0000", 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0250000000000002e-06 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741348+0000", 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116712 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.741366+0000", 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.738e-05 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165517 5.2 5:4d7c43d8:::benchmark_data_smithi053_32461_object16201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.744850+0000", 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024747319999999999, 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00256427, 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165517 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744850+0000", 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744850+0000", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744851+0000", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1399999999999995e-07 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744860+0000", 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6419999999999996e-06 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744868+0000", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1049999999999995e-06 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744874+0000", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2369999999999997e-06 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745010+0000", 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013576899999999999 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745132+0000", 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122521 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745236+0000", 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103464 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165518 5.c 5:397f26cf:::benchmark_data_smithi053_32461_object16202:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.744889+0000", 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024357329999999998, 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025668330000000001, 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165518 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744889+0000", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744889+0000", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744890+0000", 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5600000000000001e-07 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744892+0000", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4549999999999998e-06 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744899+0000", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8469999999999998e-06 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744904+0000", 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000004e-06 2024-09-12T21:52:06.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744994+0000", 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0131999999999997e-05 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745097+0000", 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010264699999999999 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:06.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745175+0000", 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999999e-05 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165519 5.e 5:7f577375:::benchmark_data_smithi053_32461_object16203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.744911+0000", 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024138520000000002, 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025833000000000002, 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165519 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744911+0000", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744911+0000", 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744911+0000", 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1600000000000002e-07 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744913+0000", 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.978e-06 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744919+0000", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.631e-06 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744924+0000", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6609999999999999e-06 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.744992+0000", 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8199000000000002e-05 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745109+0000", 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117409 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165522 5.8 5:16b648c1:::benchmark_data_smithi053_32461_object16206:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.745513+0000", 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018117649999999999, 2024-09-12T21:52:06.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020148459999999998, 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165522 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745513+0000", 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745513+0000", 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745514+0000", 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6300000000000004e-07 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745518+0000", 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8929999999999998e-06 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745526+0000", 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7489999999999998e-06 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745537+0000", 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1498000000000001e-05 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745588+0000", 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0639000000000001e-05 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745697+0000", 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010893200000000001 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165523 5.e 5.591725de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.745552+0000", 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017732309999999999, 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020083969999999999, 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165523 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745552+0000", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745552+0000", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745552+0000", 2024-09-12T21:52:06.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0900000000000002e-07 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745555+0000", 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3989999999999998e-06 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745561+0000", 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2700000000000001e-06 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745566+0000", 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9540000000000003e-06 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165524 5.2 5:46f715c6:::benchmark_data_smithi053_32461_object16208:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.745575+0000", 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001750082, 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002015298, 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165524 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745575+0000", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745575+0000", 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745575+0000", 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3299999999999998e-07 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745577+0000", 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745583+0000", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9200000000000001e-06 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745587+0000", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4059999999999998e-06 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747244+0000", 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001656743 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747372+0000", 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128252 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747501+0000", 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012895300000000001 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165526 5.4 5:264fcae6:::benchmark_data_smithi053_32461_object16210:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.745596+0000", 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001728629, 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020310160000000001, 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165526 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745596+0000", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745596+0000", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745597+0000", 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3599999999999999e-07 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745599+0000", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9199999999999998e-06 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745605+0000", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3500000000000002e-06 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745610+0000", 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7949999999999998e-06 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745827+0000", 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000216894 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745934+0000", 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001078 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:165520 5.6 e52/36 5:68de0665:::benchmark_data_smithi053_32461_object16204:head v 52'10401, mlcod=52'10398)", 2024-09-12T21:52:06.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.745633+0000", 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001692308, 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00202739, 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745633+0000", 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745633+0000", 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745633+0000", 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745636+0000", 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.399e-06 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745643+0000", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4069999999999998e-06 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.745647+0000", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.527e-06 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747460+0000", 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001813116 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747479+0000", 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8638999999999999e-05 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:165525 5.1 e52/36 5:856cbf7b:::benchmark_data_smithi053_32461_object16209:head v 52'10230, mlcod=52'10227)", 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.746426+0000", 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000899354, 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001263583, 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746426+0000", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746426+0000", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746426+0000", 2024-09-12T21:52:06.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3600000000000004e-07 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746430+0000", 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.557e-06 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746439+0000", 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6430000000000007e-06 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746454+0000", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.434e-05 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746502+0000", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8319999999999998e-05 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746530+0000", 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7994e-05 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165527 5.4 5.77631854 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.746658+0000", 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00066708999999999996, 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010601180000000001, 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165527 2024-09-12T21:52:06.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746658+0000", 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746658+0000", 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746659+0000", 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0699999999999996e-07 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746662+0000", 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8530000000000002e-06 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746672+0000", 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4939999999999992e-06 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746679+0000", 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3860000000000001e-06 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165528 5.e 5.48bacfee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.746707+0000", 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00061791299999999999, 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010372280000000001, 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165528 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746707+0000", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746707+0000", 2024-09-12T21:52:06.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746707+0000", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2599999999999998e-07 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746710+0000", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2900000000000001e-06 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746717+0000", 2024-09-12T21:52:06.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4000000000000003e-06 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.746722+0000", 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7230000000000004e-06 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165529 5.e 5.9d6558ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.747609+0000", 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997158, 2024-09-12T21:52:06.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016223600000000001, 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165529 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747609+0000", 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747609+0000", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747610+0000", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000005e-07 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747617+0000", 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4279999999999999e-06 2024-09-12T21:52:06.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747627+0000", 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2660000000000007e-06 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747633+0000", 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3300000000000004e-06 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:165530 5.5 5:a344baad:::benchmark_data_smithi053_32461_object16214:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:06.747652+0000", 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996734, 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148228, 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165530 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:06.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747652+0000", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747652+0000", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747652+0000", 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:06.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747655+0000", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.633e-06 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747661+0000", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.477e-06 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747666+0000", 2024-09-12T21:52:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8749999999999999e-06 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:06.747755+0000", 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9135999999999995e-05 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-09-12T21:52:06.806 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:06.807 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:06.808 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:06.808 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:06.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:06.812 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:06.806+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:06.813 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:06.813 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:06.813 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:06.813 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:06.909 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:06.908+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.004 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.004 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.009 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:07.008+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:07.110 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:07.109+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.210 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:07.210+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:07.213 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.214 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:07.312 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:07.311+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.379 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.379 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:07.435 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:07.434+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:07.513 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:07.512+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:07.537 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.537 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:07.614 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:07.613+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.714 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:07.713+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:07.741 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.741 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:07.815 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:07.814+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:07.912 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:07.912 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:07.916 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:07.914+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:07.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:08.017 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:08.016+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:08.081 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:08.081 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:08.094 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:08.118 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:08.117+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:08.220 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:08.218+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:08.287 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:08.287 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:08.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:08.321 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:08.320+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:08.422 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:08.420+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:08.451 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:08.452 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:08.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:08.550 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:08.549+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:08.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:52:08.624 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:08.623+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:08.653 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:08.653 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:08.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:08.751 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:08.749+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:08.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:08.826 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:08.824+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:08.871 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:08.927 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:08.926+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:08.944 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:08.944 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:08.964 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:08.965 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:08.965 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:08.968 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:08.968 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:09.028 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:09.027+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:09.028 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172558 5.c 5:35485aaa:::benchmark_data_smithi053_32461_object23242:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.017615+0000", 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096530020000000008, 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096753510000000004, 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172558 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017615+0000", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017615+0000", 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017616+0000", 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9999999999999996e-07 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017620+0000", 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8029999999999998e-06 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017630+0000", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0512e-05 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.017637+0000", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8589999999999999e-06 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025053+0000", 2024-09-12T21:52:09.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074155339999999997 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025150+0000", 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6960999999999995e-05 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025209+0000", 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9406e-05 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172534 5.4 5:2bdd0e66:::benchmark_data_smithi053_32461_object23218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.008373+0000", 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.018894661, 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018996376999999998, 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172534 2024-09-12T21:52:09.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008373+0000", 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008373+0000", 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008374+0000", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0399999999999996e-07 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008377+0000", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7099999999999999e-06 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008385+0000", 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1550000000000007e-06 2024-09-12T21:52:09.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.008391+0000", 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8420000000000001e-06 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.016746+0000", 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083555139999999996 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.016861+0000", 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115129 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172565 5.c 5:32786c21:::benchmark_data_smithi053_32461_object23249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.020229+0000", 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0070391830000000001, 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071834719999999998, 2024-09-12T21:52:09.038 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172565 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020229+0000", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020229+0000", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020230+0000", 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0500000000000002e-07 2024-09-12T21:52:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020233+0000", 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8569999999999999e-06 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020241+0000", 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8519999999999993e-06 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020247+0000", 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0839999999999997e-06 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026535+0000", 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006287066 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026642+0000", 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107495 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026738+0000", 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5573000000000001e-05 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172570 5.c 5.cbe2dcbc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.023338+0000", 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039304179999999998, 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041186139999999996, 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172570 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023338+0000", 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023338+0000", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023338+0000", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3399999999999999e-07 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023349+0000", 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0854e-05 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023359+0000", 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150000000000003e-06 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023365+0000", 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2559999999999999e-06 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172543 5.4 5:2d9cd015:::benchmark_data_smithi053_32461_object23227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.011718+0000", 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.015549647, 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015772583999999999, 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172543 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011718+0000", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011718+0000", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011719+0000", 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.08e-07 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011721+0000", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011728+0000", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7700000000000004e-06 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.011732+0000", 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6099999999999999e-06 2024-09-12T21:52:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.018412+0000", 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006679417 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.018542+0000", 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012978999999999999 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172571 5.4 5.2462ef54 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.023420+0000", 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038483010000000002, 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004103883, 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172571 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023420+0000", 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023420+0000", 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023421+0000", 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6199999999999996e-07 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023425+0000", 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5970000000000002e-06 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023433+0000", 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1489999999999994e-06 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023440+0000", 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3999999999999997e-06 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172544 5.4 5:20a923c4:::benchmark_data_smithi053_32461_object23228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.012429+0000", 2024-09-12T21:52:09.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.014838553000000001, 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015122435, 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172544 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012429+0000", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012429+0000", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012430+0000", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2999999999999999e-07 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012434+0000", 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3249999999999999e-06 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012443+0000", 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2550000000000003e-06 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.012449+0000", 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4540000000000004e-06 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020059+0000", 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076100179999999996 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.020166+0000", 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010618100000000001 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172547 5.4 5:22e9c36e:::benchmark_data_smithi053_32461_object23231:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.013715+0000", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.013553153, 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013872765, 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172547 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013715+0000", 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013715+0000", 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013716+0000", 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.68e-07 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013719+0000", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6160000000000002e-06 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013727+0000", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0560000000000005e-06 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013732+0000", 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2580000000000003e-06 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.021705+0000", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079727319999999997 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.021817+0000", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011173 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:172552 5.c e52/21)", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.025347+0000", 2024-09-12T21:52:09.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019209800000000001, 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022720309999999999, 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025347+0000", 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025347+0000", 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025348+0000", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025351+0000", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4649999999999999e-06 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025361+0000", 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0195e-05 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025368+0000", 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3249999999999996e-06 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172550 5.c 5:396f713a:::benchmark_data_smithi053_32461_object23234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.013788+0000", 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.013479934000000001, 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013872607, 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172550 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013788+0000", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013788+0000", 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013788+0000", 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5900000000000003e-07 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013790+0000", 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-06 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013796+0000", 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2179999999999996e-06 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.013801+0000", 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.021691+0000", 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078900029999999996 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.021816+0000", 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124907 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.021929+0000", 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113442 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.025021+0000", 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003091566 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172576 5.b 5:d1aff126:::benchmark_data_smithi053_32461_object23260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.026277+0000", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00099092999999999989, 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014591560000000001, 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172576 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026277+0000", 2024-09-12T21:52:09.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026277+0000", 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026278+0000", 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4799999999999997e-07 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026282+0000", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6600000000000001e-06 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026290+0000", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.67e-06 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026297+0000", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0040000000000002e-06 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026339+0000", 2024-09-12T21:52:09.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2289000000000001e-05 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026417+0000", 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7915000000000002e-05 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:172577 5.a e52/51 5:566ba125:::benchmark_data_smithi053_32461_object23261:head v 52'10651, mlcod=52'10649)", 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.026573+0000", 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00069550299999999998, 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001229571, 2024-09-12T21:52:09.074 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026573+0000", 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026573+0000", 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026573+0000", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1600000000000001e-07 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026578+0000", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8439999999999997e-06 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026598+0000", 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9930000000000001e-05 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026604+0000", 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9959999999999999e-06 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026651+0000", 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6589999999999999e-05 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026672+0000", 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:172552 5.c 5:3dbe5a18:::benchmark_data_smithi053_32461_object23236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.014959+0000", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012308796, 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01290854, 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 172552 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014959+0000", 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014959+0000", 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014960+0000", 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.16e-07 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014964+0000", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0110000000000002e-06 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014974+0000", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3710000000000006e-06 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.014980+0000", 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-12T21:52:09.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023590+0000", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086098010000000003 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023660+0000", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9720000000000003e-05 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.023752+0000", 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1947999999999994e-05 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:172558 5.c e52/21)", 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:09.026706+0000", 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00056180800000000001, 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012244230000000001, 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026706+0000", 2024-09-12T21:52:09.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026706+0000", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026707+0000", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000005e-07 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026710+0000", 2024-09-12T21:52:09.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4920000000000002e-06 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026718+0000", 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9759999999999995e-06 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:09.026725+0000", 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3720000000000001e-06 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.085 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:09.086 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-09-12T21:52:09.086 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:09.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:09.128 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:09.127+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:09.229 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:09.228+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:09.279 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:09.279 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:09.279 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:09.279 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:09.279 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:09.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:09.330 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:09.328+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:09.431 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:09.429+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:09.490 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.148077878999999, 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.491 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:09.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:09.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.146756353000001, 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:09.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:09.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:09.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.146268509999999, 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:09.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.145541129000001, 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44657 5.3 5:c3da6483:::benchmark_data_smithi053_32461_object44656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.139746572, 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058705691999999997, 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44657 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348057+0000", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348058+0000", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348147+0000", 2024-09-12T21:52:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9381000000000004e-05 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348156+0000", 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348161+0000", 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1699999999999996e-06 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348197+0000", 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669e-05 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348274+0000", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7577000000000006e-05 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.348352+0000", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7742000000000002e-05 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.349471+0000", 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011185920000000001 2024-09-12T21:52:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406626+0000", 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057155630999999998 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406729+0000", 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102942 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406762+0000", 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3120000000000001e-05 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.178697077999999, 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.178569619000001, 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.178510998999997, 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.176399353000001, 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.174742410999997, 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.173792812000002, 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:09.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.169568724999998, 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:09.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:09.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:09.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:09.570 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.167215186999996, 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:09.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:09.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.165591995, 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:09.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:09.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:103044 5.a 5:552a3710:::benchmark_data_smithi053_32461_object103043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396897396, 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440368000000001, 2024-09-12T21:52:09.583 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 103044 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:09.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090906+0000", 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090935+0000", 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8841000000000001e-05 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090948+0000", 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2204999999999999e-05 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.090953+0000", 2024-09-12T21:52:09.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2839999999999997e-06 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106548+0000", 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015595400000000001 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106673+0000", 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012490999999999999 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.106815+0000", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142132 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115066+0000", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082502679999999998 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115189+0000", 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012320500000000001 2024-09-12T21:52:09.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115242+0000", 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3275000000000001e-05 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:39.115346+0000", 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104353 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:121661 5.8 5:1f145822:::benchmark_data_smithi053_32461_object121660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.272291063000001, 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024161874, 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 121661 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215512+0000", 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215513+0000", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215538+0000", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5423999999999999e-05 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215546+0000", 2024-09-12T21:52:09.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1110000000000008e-06 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.215551+0000", 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222267+0000", 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067153530000000003 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.222374+0000", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107388 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239531+0000", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017156457 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239579+0000", 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999998e-05 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:47.239674+0000", 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5137999999999996e-05 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124592 5.a 5:5d57876c:::benchmark_data_smithi053_32461_object124591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.974045815, 2024-09-12T21:52:09.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027306759999999999, 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124592 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513758+0000", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9500000000000002e-07 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513815+0000", 2024-09-12T21:52:09.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513824+0000", 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6279999999999994e-06 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.513830+0000", 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2960000000000004e-06 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.527993+0000", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014162354 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528126+0000", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133478 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.528287+0000", 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016105399999999999 2024-09-12T21:52:09.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.536548+0000", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082610300000000008 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540888+0000", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043398630000000002 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.540967+0000", 2024-09-12T21:52:09.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8529000000000007e-05 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541064+0000", 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7767000000000001e-05 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:124595 5.2 5:40280d24:::benchmark_data_smithi053_32461_object124594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:09.602 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.971030328000001, 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024495987, 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124595 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:09.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516773+0000", 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516774+0000", 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2600000000000001e-07 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516827+0000", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-05 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516835+0000", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1540000000000002e-06 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.516841+0000", 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:09.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.531960+0000", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015118995 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532050+0000", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0532000000000007e-05 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.532190+0000", 2024-09-12T21:52:09.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139493 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541008+0000", 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088186359999999995 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541145+0000", 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136876 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541179+0000", 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3318999999999997e-05 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:48.541269+0000", 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0387e-05 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135739 5.a 5:5413153c:::benchmark_data_smithi053_32461_object135738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.11466806, 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024892322000000001, 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135739 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373135+0000", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373136+0000", 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6400000000000002e-07 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373163+0000", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879000000000001e-05 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373170+0000", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373176+0000", 2024-09-12T21:52:09.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380647+0000", 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007471831 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380727+0000", 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9899000000000002e-05 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380816+0000", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8534000000000003e-05 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387276+0000", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064597589999999998 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397934+0000", 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01065841 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397973+0000", 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9101999999999999e-05 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398028+0000", 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4447999999999998e-05 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:135742 5.2 5:46909c6c:::benchmark_data_smithi053_32461_object135741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.114137209999999, 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024434088, 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135742 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:09.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373666+0000", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373667+0000", 2024-09-12T21:52:09.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9299999999999999e-07 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373731+0000", 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4814999999999995e-05 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373738+0000", 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.373741+0000", 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380643+0000", 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069010679999999998 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380735+0000", 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2967999999999995e-05 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.380819+0000", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3438999999999999e-05 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.387031+0000", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062123509999999996 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.397964+0000", 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010933025000000001 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398017+0000", 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2397e-05 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:53.398100+0000", 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3558000000000002e-05 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:09.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:09.621 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:09.622 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:09.620+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:09.623 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:52:09.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:09.723 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:09.721+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174920 5.1 5:8b75b40d:::benchmark_data_smithi053_32461_object25604:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.764191+0000", 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0048237769999999996, 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048479650000000001, 2024-09-12T21:52:09.771 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174920 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764191+0000", 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764191+0000", 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764192+0000", 2024-09-12T21:52:09.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764195+0000", 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6289999999999999e-06 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764206+0000", 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0958000000000001e-05 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764210+0000", 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.031e-06 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764410+0000", 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019993100000000001 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764530+0000", 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119858 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.764638+0000", 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107531 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174921 5.1 5:8d27bfa7:::benchmark_data_smithi053_32461_object25605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.765126+0000", 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0038892219999999999, 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0039916329999999996, 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174921 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765126+0000", 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765126+0000", 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765126+0000", 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6400000000000001e-07 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765130+0000", 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7409999999999998e-06 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765139+0000", 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5110000000000003e-06 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765145+0000", 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8669999999999999e-06 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.766291+0000", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011460330000000001 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.766396+0000", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000105756 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.766491+0000", 2024-09-12T21:52:09.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4702000000000002e-05 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174922 5.1 5:888e52b7:::benchmark_data_smithi053_32461_object25606:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.765157+0000", 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0038579, 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040321039999999999, 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174922 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765157+0000", 2024-09-12T21:52:09.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765157+0000", 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765157+0000", 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8000000000000001e-07 2024-09-12T21:52:09.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765159+0000", 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0389999999999999e-06 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765165+0000", 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7899999999999996e-06 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765170+0000", 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5090000000000004e-06 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767782+0000", 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026126949999999999 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767887+0000", 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010450699999999999 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767998+0000", 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110778 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174932 5.7 5:e55fa653:::benchmark_data_smithi053_32461_object25616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.765841+0000", 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031736260000000001, 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003418627, 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.788 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174932 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765841+0000", 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.789 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765841+0000", 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765842+0000", 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4000000000000001e-07 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765846+0000", 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7000000000000002e-06 2024-09-12T21:52:09.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765853+0000", 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5900000000000002e-06 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765858+0000", 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5399999999999997e-06 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.765901+0000", 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3378999999999999e-05 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.766018+0000", 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116978 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.766123+0000", 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000104746 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768946+0000", 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028232520000000001 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.793 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:174928 5.3 e53/21 5:cb750b41:::benchmark_data_smithi053_32461_object25612:head v 53'11161, mlcod=53'11159)", 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.767279+0000", 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0017353049999999999, 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020400919999999999, 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767279+0000", 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767279+0000", 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767280+0000", 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6600000000000002e-07 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767284+0000", 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.58e-06 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767290+0000", 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8809999999999998e-06 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767295+0000", 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4410000000000003e-06 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767343+0000", 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7787000000000002e-05 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767363+0000", 2024-09-12T21:52:09.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9860999999999998e-05 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174934 5.9 5:9fa24f53:::benchmark_data_smithi053_32461_object25618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.767322+0000", 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0016927839999999999, 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020343499999999999, 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.798 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174934 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767322+0000", 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767322+0000", 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767323+0000", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767326+0000", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4750000000000002e-06 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767334+0000", 2024-09-12T21:52:09.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7400000000000004e-06 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767339+0000", 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8999999999999997e-06 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767684+0000", 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000344698 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767796+0000", 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112495 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174935 5.6 5:6fbc01fc:::benchmark_data_smithi053_32461_object25619:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.767443+0000", 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015715169999999999, 2024-09-12T21:52:09.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019770730000000002, 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174935 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767443+0000", 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767443+0000", 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767444+0000", 2024-09-12T21:52:09.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7e-07 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767446+0000", 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.39e-06 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767451+0000", 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0159999999999999e-06 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767454+0000", 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.269e-06 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767499+0000", 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4759000000000003e-05 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767617+0000", 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011754100000000001 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767727+0000", 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110727 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174936 5.a 5:511377aa:::benchmark_data_smithi053_32461_object25620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.767462+0000", 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001552587, 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020354050000000001, 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174936 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767462+0000", 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767462+0000", 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767463+0000", 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5900000000000003e-07 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767465+0000", 2024-09-12T21:52:09.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0159999999999998e-06 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767472+0000", 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4150000000000002e-06 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767475+0000", 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9399999999999998e-06 2024-09-12T21:52:09.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767517+0000", 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370000000000003e-05 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:09.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767593+0000", 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5982999999999994e-05 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.767672+0000", 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8265999999999999e-05 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174937 5.1 5.f0185d51 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.768334+0000", 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00068048200000000005, 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012263179999999999, 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.815 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174937 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768334+0000", 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768334+0000", 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768335+0000", 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1299999999999999e-07 2024-09-12T21:52:09.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768339+0000", 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6109999999999998e-06 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768348+0000", 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8200000000000003e-06 2024-09-12T21:52:09.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.768353+0000", 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7930000000000003e-06 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769553+0000", 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001199758 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.819 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:174938 5.9 5.7e3ca299 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:09.769173+0000", 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998412, 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00041979099999999998, 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:09.820 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 174938 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769173+0000", 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769173+0000", 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769174+0000", 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5099999999999999e-07 2024-09-12T21:52:09.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769178+0000", 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6820000000000001e-06 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769186+0000", 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2810000000000008e-06 2024-09-12T21:52:09.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:09.769193+0000", 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3579999999999999e-06 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.824 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:09.825 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:09.825 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 10 2024-09-12T21:52:09.825 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:09.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:09.827 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:09.825+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:09.927 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:09.926+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.014 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:10.014 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:10.015 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:10.015 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:10.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:10.028 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:10.027+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.129 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:10.127+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:10.179 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:10.179 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:10.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.866051054000003, 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.180 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:10.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.864429659000002, 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:10.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:10.191 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.864339630000003, 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:10.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.861167928999997, 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.197 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:10.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:10.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.860647673999999, 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.203 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:10.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:10.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.854064188000002, 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.209 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:10.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 48.841454376000002, 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.215 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:10.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:10.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:10.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6682082280000001, 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.221 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:10.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:10.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6656574649999998, 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:10.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:10.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6630817780000005, 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:10.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:10.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6608945559999997, 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:10.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.247 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6558059289999996, 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:10.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6446326429999996, 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:10.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:10.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:10.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6408393649999997, 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:10.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:10.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6330453179999997, 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.268 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:10.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.6014185630000002, 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:10.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:10.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:10.280 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.5825590549999999, 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.281 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:10.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.5777650300000001, 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:10.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.293 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.5764608850000004, 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:10.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:10.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.5665081499999998, 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:10.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:10.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:10.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:10.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.306 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.307 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:10.307 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:10.307 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:10.308 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:10.307+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:10.409 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:10.407+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:10.463 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:177137 5.a e53/51 5:56f72382:::benchmark_data_smithi053_32461_object27821:head v 53'10911, mlcod=53'10909)", 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.460645+0000", 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001501966, 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015213780000000001, 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460645+0000", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460645+0000", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460646+0000", 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.58e-07 2024-09-12T21:52:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460649+0000", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2849999999999999e-06 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460656+0000", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6649999999999997e-06 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460660+0000", 2024-09-12T21:52:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460741+0000", 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0939999999999994e-05 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460759+0000", 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8150000000000001e-05 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:177128 5.2 e53/36 ondisk, result = 0)", 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.461572+0000", 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000574966, 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065211499999999999, 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461572+0000", 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461572+0000", 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461573+0000", 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4200000000000001e-07 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461575+0000", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3149999999999999e-06 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461584+0000", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5329999999999994e-06 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461589+0000", 2024-09-12T21:52:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4430000000000002e-06 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462128+0000", 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000538932 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462137+0000", 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4910000000000005e-06 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:177125 5.5 e53/21)", 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.461598+0000", 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00054950699999999997, 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067633799999999996, 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461598+0000", 2024-09-12T21:52:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461598+0000", 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461598+0000", 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8799999999999999e-07 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461600+0000", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6050000000000001e-06 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461605+0000", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9960000000000001e-06 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461609+0000", 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1409999999999998e-06 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:177127 5.5 e53/21)", 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.462059+0000", 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8395999999999999e-05, 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025493100000000002, 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462059+0000", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462059+0000", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462059+0000", 2024-09-12T21:52:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999999e-07 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462062+0000", 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0139999999999999e-06 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462070+0000", 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9009999999999994e-06 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462076+0000", 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6409999999999999e-06 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177121 5.5 5:a48d2e97:::benchmark_data_smithi053_32461_object27805:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.455091+0000", 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0070567609999999999, 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072704470000000002, 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177121 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455091+0000", 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455091+0000", 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455091+0000", 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0299999999999998e-07 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455096+0000", 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1609999999999996e-06 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455105+0000", 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4450000000000002e-06 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455111+0000", 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2910000000000004e-06 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455161+0000", 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9465000000000002e-05 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455273+0000", 2024-09-12T21:52:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112223 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.455380+0000", 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107366 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460567+0000", 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051870689999999999 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462369+0000", 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018019830000000001 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177125 5.5 5:ac265289:::benchmark_data_smithi053_32461_object27809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.456893+0000", 2024-09-12T21:52:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052539750000000001, 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055505820000000001, 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177125 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456893+0000", 2024-09-12T21:52:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456893+0000", 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456894+0000", 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1999999999999999e-07 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456898+0000", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4850000000000001e-06 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456905+0000", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8499999999999994e-06 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456911+0000", 2024-09-12T21:52:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9370000000000001e-06 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456946+0000", 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4418000000000001e-05 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457047+0000", 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010173199999999999 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457153+0000", 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105628 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460572+0000", 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034193409999999998 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177127 5.5 5:a6c2cc7d:::benchmark_data_smithi053_32461_object27811:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.456956+0000", 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005191775, 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055590769999999999, 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177127 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456956+0000", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456956+0000", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456956+0000", 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8800000000000002e-07 2024-09-12T21:52:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456959+0000", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.96e-06 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456967+0000", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4789999999999999e-06 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.456972+0000", 2024-09-12T21:52:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.458735+0000", 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017634269999999999 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.458861+0000", 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125081 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.458972+0000", 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011143500000000001 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462484+0000", 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003512285 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177130 5.5 5:a0bf6b52:::benchmark_data_smithi053_32461_object27814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.457423+0000", 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047240700000000004, 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051645959999999996, 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177130 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457423+0000", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457423+0000", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457424+0000", 2024-09-12T21:52:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1399999999999998e-07 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457426+0000", 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.995e-06 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457431+0000", 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7620000000000001e-06 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.457436+0000", 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4379999999999997e-06 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460603+0000", 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031669319999999999 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460728+0000", 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125358 2024-09-12T21:52:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460862+0000", 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013423800000000001 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177134 5.8 5:1c61a59a:::benchmark_data_smithi053_32461_object27818:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.460204+0000", 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019428850000000001, 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024536689999999999, 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177134 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460204+0000", 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460204+0000", 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460205+0000", 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4199999999999996e-07 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460207+0000", 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4739999999999999e-06 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460212+0000", 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.313e-06 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460217+0000", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460269+0000", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1962999999999997e-05 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460385+0000", 2024-09-12T21:52:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011586000000000001 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177138 5.3 5:c866f4a6:::benchmark_data_smithi053_32461_object27822:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.460233+0000", 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001913854, 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024866160000000001, 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177138 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460233+0000", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460233+0000", 2024-09-12T21:52:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460234+0000", 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9299999999999998e-07 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460236+0000", 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4229999999999999e-06 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460243+0000", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0229999999999998e-06 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460248+0000", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6149999999999996e-06 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460317+0000", 2024-09-12T21:52:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9060999999999995e-05 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460420+0000", 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102328 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460517+0000", 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7639999999999994e-05 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177139 5.3 5:c07983f4:::benchmark_data_smithi053_32461_object27823:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.460261+0000", 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001885921, 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025292560000000001, 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177139 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460261+0000", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460261+0000", 2024-09-12T21:52:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460262+0000", 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5400000000000002e-07 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460264+0000", 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4320000000000002e-06 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460270+0000", 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460275+0000", 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0509999999999996e-06 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462712+0000", 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024369690000000002 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.462792+0000", 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9929e-05 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:177136 5.6 e53/36 5:68913f6f:::benchmark_data_smithi053_32461_object27820:head v 53'11155, mlcod=53'11153)", 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.460595+0000", 2024-09-12T21:52:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001552304, 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022644119999999999, 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460595+0000", 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460595+0000", 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460595+0000", 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1e-07 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460599+0000", 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4759999999999998e-06 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460605+0000", 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2829999999999998e-06 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.460609+0000", 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2230000000000001e-06 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461222+0000", 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00061222299999999996 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.461241+0000", 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9108000000000001e-05 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-09-12T21:52:10.519 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:10.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:10.521 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:10.519+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.622 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:10.621+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:10.718 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:10.759 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:10.758+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:10.823 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:10.821+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.580774085999998, 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.57945256, 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.578964716999998, 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.578237336000001, 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.611393284999998, 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.611265826, 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.611207206000003, 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.60909556, 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.607438618000003, 2024-09-12T21:52:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.606489019000001, 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.602264931999997, 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.599911394000003, 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.598288201999999, 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.238942182, 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.23722539300000001, 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.236486586, 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.236450877, 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.23215277100000001, 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.22827304600000001, 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.22602262300000001, 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:11.046 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:11.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:11.048 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.045+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:11.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-09-12T21:52:11.147 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:11.146+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:11.172 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:11.173 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:11.191 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:11.194 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:11.195 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:11.198 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:11.198 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:11.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:11.249 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:11.248+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:11.349 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.348+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.354 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:11.354 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:11.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:11.450 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.449+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.551 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:11.550+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:11.558 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:11.558 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:11.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:11.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:52:11.651 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.650+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.724 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:11.724 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:11.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:11.752 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.751+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.853 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:11.851+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:11.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:11.954 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:11.953+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.056 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.054+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.058 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.058 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.071 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:12.157 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.156+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.232 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:12.257 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.256+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.358 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.357+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.380 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.380 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:12.459 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:12.457+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:12.518 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:52:12.540 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.540 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:12.596 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.595+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.661 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:12.659+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:12.706 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.706 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.718 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:12.762 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:12.761+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:12.863 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:12.861+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:12.913 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:12.914 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:12.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:12.964 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:12.962+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:13.064 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:13.063+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:13.079 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:13.079 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:13.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:13.165 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:13.164+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:13.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:13.240 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:13.241 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:13.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:13.294 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:13.292+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:13.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:13.322 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:13.340 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:13.340 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:13.340 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:13.344 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:13.344 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:13.366 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:13.365+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:13.440 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:13.440 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:13.440 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:13.440 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:13.440 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:13.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:13.467 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:13.466+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:13.568 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:13.567+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:13.642 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:13.642 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:13.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:13.642 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.329039526000003, 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:13.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:13.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:13.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:13.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.327418131000002, 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.649 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:13.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.327328102000003, 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:13.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.324156401000003, 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:13.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:13.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.323636145999998, 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:13.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:13.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.317052660000002, 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.673 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:13.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:13.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 52.304442848000001, 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:13.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1311967000000003, 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:13.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:13.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:13.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1286459369999999, 2024-09-12T21:52:13.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:13.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:13.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:13.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.699 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1260702499999997, 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.700 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:13.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:13.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1238830279999998, 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:13.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:13.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1187944010000006, 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:13.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:13.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:13.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:13.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1076211150000006, 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.721 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:13.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.1038278370000008, 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.734 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0960337899999999, 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.735 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:13.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:13.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:13.741 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0644070350000003, 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:13.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:13.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:13.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0455475270000001, 2024-09-12T21:52:13.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:13.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:13.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0407535019999994, 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.755 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:13.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:13.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.761 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0394493570000005, 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.762 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:13.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 8.0294966219999999, 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:13.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:13.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:13.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:13.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:13.776 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:13.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:13.778 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:13.775+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:13.878 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:13.877+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:187863 5.1 e54/36 5:893ca1ba:::benchmark_data_smithi053_32461_object38547:head v 54'11666, mlcod=54'11663)", 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.929949+0000", 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00048480000000000002, 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00050893399999999995, 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929949+0000", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929949+0000", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929949+0000", 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9000000000000002e-07 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929953+0000", 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6210000000000001e-06 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929958+0000", 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3909999999999997e-06 2024-09-12T21:52:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929961+0000", 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.179e-06 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929995+0000", 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3825999999999998e-05 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930021+0000", 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5449999999999999e-05 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187851 5.e 5:713479ec:::benchmark_data_smithi053_32461_object38535:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.925343+0000", 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050904330000000001, 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051765889999999997, 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187851 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925343+0000", 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925343+0000", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925344+0000", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.015e-06 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925348+0000", 2024-09-12T21:52:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4150000000000001e-06 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925359+0000", 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0682e-05 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925367+0000", 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0609999999999996e-06 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925525+0000", 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015787900000000001 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925651+0000", 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012637600000000001 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187853 5.8 5:183c8569:::benchmark_data_smithi053_32461_object38537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.925414+0000", 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050196340000000002, 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005169519, 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187853 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925414+0000", 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925414+0000", 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925414+0000", 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8800000000000003e-07 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925417+0000", 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925424+0000", 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3810000000000001e-06 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925430+0000", 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5990000000000001e-06 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925476+0000", 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6146000000000002e-05 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.925583+0000", 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106907 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930585+0000", 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050023960000000001 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187856 5.8 5:1d9a3404:::benchmark_data_smithi053_32461_object38540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.926442+0000", 2024-09-12T21:52:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039915310000000004, 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042106369999999997, 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187856 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926442+0000", 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926442+0000", 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926443+0000", 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-07 2024-09-12T21:52:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926457+0000", 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4489e-05 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926466+0000", 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6649999999999992e-06 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926474+0000", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8189999999999992e-06 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927324+0000", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085016400000000004 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927432+0000", 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010809199999999999 2024-09-12T21:52:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187857 5.8 5:1e8a1bc4:::benchmark_data_smithi053_32461_object38541:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.926870+0000", 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003563755, 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038506719999999999, 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187857 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926870+0000", 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926870+0000", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926871+0000", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2500000000000004e-07 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926874+0000", 2024-09-12T21:52:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5090000000000002e-06 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926882+0000", 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1790000000000008e-06 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.926888+0000", 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7620000000000001e-06 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928950+0000", 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002061603 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929072+0000", 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012233400000000001 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:187858 5.a e54/51 5:52bdf21e:::benchmark_data_smithi053_32461_object38542:head v 54'11529, mlcod=54'11526)", 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.927878+0000", 2024-09-12T21:52:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025549969999999998, 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029062770000000001, 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927878+0000", 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927878+0000", 2024-09-12T21:52:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927879+0000", 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7300000000000002e-07 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927882+0000", 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1329999999999999e-06 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927888+0000", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8459999999999996e-06 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927892+0000", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.002e-06 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927928+0000", 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6520000000000003e-05 2024-09-12T21:52:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.927949+0000", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000002e-05 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930750+0000", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028016669999999999 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930785+0000", 2024-09-12T21:52:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4737000000000003e-05 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:187859 5.a e54/51 5:55367053:::benchmark_data_smithi053_32461_object38543:head v 54'11530, mlcod=54'11526)", 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.928874+0000", 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015598070000000001, 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019767880000000002, 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928874+0000", 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928874+0000", 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928874+0000", 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2500000000000001e-07 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928878+0000", 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0450000000000002e-06 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928885+0000", 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0589999999999997e-06 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928889+0000", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2400000000000001e-06 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929642+0000", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075268799999999995 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929659+0000", 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7175000000000001e-05 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187861 5.3 5:c6c8ba48:::benchmark_data_smithi053_32461_object38545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.928990+0000", 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014437460000000001, 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923625, 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187861 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928990+0000", 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928990+0000", 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928991+0000", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-06 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.928994+0000", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929003+0000", 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2609999999999993e-06 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929018+0000", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5886e-05 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929057+0000", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8711999999999998e-05 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929132+0000", 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4683000000000003e-05 2024-09-12T21:52:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929196+0000", 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3732999999999994e-05 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187862 5.8 5:133b7e54:::benchmark_data_smithi053_32461_object38546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.929031+0000", 2024-09-12T21:52:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014026010000000001, 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019489679999999999, 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187862 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929031+0000", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929031+0000", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929031+0000", 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3399999999999999e-07 2024-09-12T21:52:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929034+0000", 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4849999999999999e-06 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929041+0000", 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7789999999999998e-06 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929046+0000", 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2499999999999997e-06 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930742+0000", 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001695698 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930832+0000", 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0845000000000002e-05 2024-09-12T21:52:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187864 5.e 5:7dc015d4:::benchmark_data_smithi053_32461_object38548:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.929238+0000", 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011956709999999999, 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001801609, 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187864 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929238+0000", 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929238+0000", 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929239+0000", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929243+0000", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.036e-06 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929252+0000", 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6989999999999998e-06 2024-09-12T21:52:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929260+0000", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0250000000000002e-06 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929364+0000", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103578 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929485+0000", 2024-09-12T21:52:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012062599999999999 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187865 5.8 5.6be17448 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.929845+0000", 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00058832899999999996, 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001249993, 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187865 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929845+0000", 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929845+0000", 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929846+0000", 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3399999999999998e-07 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929850+0000", 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0969999999999999e-06 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929866+0000", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6229999999999999e-05 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929874+0000", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.294e-06 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:187866 5.3 5:c7f5d8fc:::benchmark_data_smithi053_32461_object38550:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:13.929915+0000", 2024-09-12T21:52:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00051895000000000001, 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001229249, 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187866 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929915+0000", 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929915+0000", 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929915+0000", 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2300000000000001e-07 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929918+0000", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929927+0000", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4540000000000007e-06 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.929933+0000", 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8250000000000001e-06 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930886+0000", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095303200000000003 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.930985+0000", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9667000000000006e-05 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:13.931098+0000", 2024-09-12T21:52:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112969 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-09-12T21:52:13.985 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:13.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:13.987 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:13.985+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:14.088 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:14.086+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:14.186 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:14.186 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:14.187 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:14.186+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:14.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:14.288 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:14.287+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:14.389 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:14.387+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:14.390 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.047627327000001, 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:14.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:14.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.046305801000003, 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:14.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:14.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.045817958000001, 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:14.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:14.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.045090577000003, 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:14.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.078246526000001, 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:14.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:14.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.078119067000003, 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:14.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.078060446999999, 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:14.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.075948801000003, 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:14.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.074291858999999, 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:14.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:14.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.073342259999997, 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:14.443 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:14.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:14.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:14.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.069118173, 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:14.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:14.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:14.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.066764634999998, 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:14.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:14.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.065141443000002, 2024-09-12T21:52:14.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:14.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.468 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7057954230000001, 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:14.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:14.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:14.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.704078634, 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:14.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:14.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:14.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7033398269999998, 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:14.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7033041180000001, 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:14.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:14.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6990060119999999, 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:14.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:14.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6951262869999999, 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:14.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:14.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6928758639999999, 2024-09-12T21:52:14.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:14.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:14.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:14.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:14.511 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:14.510+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:14.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:14.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:14.612 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:14.610+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190139 5.a 5:53ea76bf:::benchmark_data_smithi053_32461_object40823:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.653812+0000", 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0039801949999999997, 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040150400000000001, 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.660 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190139 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653812+0000", 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653812+0000", 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653813+0000", 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1200000000000001e-07 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653817+0000", 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0740000000000003e-06 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653827+0000", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6989999999999998e-06 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653834+0000", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6229999999999999e-06 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.653932+0000", 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8624999999999998e-05 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654049+0000", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011624399999999999 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654165+0000", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116716 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657586+0000", 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034208929999999999 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.664 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:190128 5.2 e54/36 5:4bc19371:::benchmark_data_smithi053_32461_object40812:head v 54'11716, mlcod=54'11712)", 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.654648+0000", 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031444519999999998, 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032648989999999999, 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654648+0000", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654648+0000", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654648+0000", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5100000000000001e-07 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654652+0000", 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.067e-06 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654663+0000", 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1263e-05 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654668+0000", 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7899999999999999e-06 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.667 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656007+0000", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001339245 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656027+0000", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9894999999999998e-05 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190143 5.a 5:53817923:::benchmark_data_smithi053_32461_object40827:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.654823+0000", 2024-09-12T21:52:14.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029696459999999998, 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031589420000000001, 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190143 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654823+0000", 2024-09-12T21:52:14.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654823+0000", 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654824+0000", 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5899999999999996e-07 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654828+0000", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3089999999999997e-06 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654836+0000", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0330000000000008e-06 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.654849+0000", 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2777e-05 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657618+0000", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027695110000000001 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657742+0000", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012382499999999999 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657846+0000", 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000104178 2024-09-12T21:52:14.672 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190147 5.a 5.cca8b7aa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.655547+0000", 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002245482, 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002512533, 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.673 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190147 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655547+0000", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655547+0000", 2024-09-12T21:52:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655548+0000", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3799999999999996e-07 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655552+0000", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9920000000000001e-06 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655562+0000", 2024-09-12T21:52:14.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0081999999999999e-05 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.655568+0000", 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9560000000000002e-06 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:190149 5.3 e54/21 5:cb8ed630:::benchmark_data_smithi053_32461_object40833:head v 54'12116, mlcod=54'12113)", 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.656833+0000", 2024-09-12T21:52:14.676 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00095935499999999995, 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001283843, 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656833+0000", 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656833+0000", 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656834+0000", 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1100000000000001e-07 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656838+0000", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7730000000000001e-06 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656846+0000", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1799999999999996e-06 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656851+0000", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.101e-06 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656886+0000", 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5496e-05 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.656898+0000", 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2091e-05 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:190139 5.a e54/51 ondisk, result = 0)", 2024-09-12T21:52:14.680 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.657076+0000", 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000716575, 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001101674, 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657076+0000", 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.681 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657076+0000", 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657077+0000", 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5499999999999998e-07 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657080+0000", 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0709999999999999e-06 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657088+0000", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4100000000000008e-06 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657093+0000", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7140000000000001e-06 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657566+0000", 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00047272599999999997 2024-09-12T21:52:14.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657581+0000", 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5061e-05 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190150 5.d 5:b3cc5097:::benchmark_data_smithi053_32461_object40834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.657641+0000", 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00015129499999999999, 2024-09-12T21:52:14.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00059598099999999998, 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190150 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657641+0000", 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657641+0000", 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657642+0000", 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6499999999999998e-07 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657647+0000", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8010000000000003e-06 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657660+0000", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3207000000000001e-05 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657667+0000", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9129999999999997e-06 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657721+0000", 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3372000000000003e-05 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657811+0000", 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.0705000000000007e-05 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190152 5.a 5.f74030ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.657731+0000", 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 6.1601999999999997e-05, 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058019899999999999, 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190152 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657731+0000", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657731+0000", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657732+0000", 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5000000000000002e-07 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657736+0000", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3120000000000004e-06 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657745+0000", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8890000000000008e-06 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657751+0000", 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9279999999999998e-06 2024-09-12T21:52:14.691 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190155 5.1 5:8e9b249c:::benchmark_data_smithi053_32461_object40839:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.657946+0000", 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998465, 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00042629000000000001, 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190155 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657946+0000", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657946+0000", 2024-09-12T21:52:14.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657947+0000", 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2099999999999997e-07 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657950+0000", 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3840000000000001e-06 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657957+0000", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8229999999999997e-06 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.657961+0000", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5820000000000003e-06 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658003+0000", 2024-09-12T21:52:14.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1261999999999999e-05 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658106+0000", 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103294 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658204+0000", 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7940000000000001e-05 2024-09-12T21:52:14.696 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190157 5.a 5.cc5a201a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.658008+0000", 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9997845, 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00044008699999999998, 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.697 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190157 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658008+0000", 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658008+0000", 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658009+0000", 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2399999999999997e-07 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658013+0000", 2024-09-12T21:52:14.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9720000000000003e-06 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658021+0000", 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2940000000000006e-06 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658028+0000", 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1829999999999999e-06 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.700 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:190153 5.c e54/21 5:32826335:::benchmark_data_smithi053_32461_object40837:head v 54'11748, mlcod=54'11746)", 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.658143+0000", 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.99965, 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00035867000000000001, 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658143+0000", 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658143+0000", 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658143+0000", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7999999999999996e-07 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658147+0000", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7409999999999998e-06 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658153+0000", 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4330000000000003e-06 2024-09-12T21:52:14.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658156+0000", 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8330000000000004e-06 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658192+0000", 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6099000000000001e-05 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658204+0000", 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1454000000000001e-05 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:190159 5.7 5:e81a1f6f:::benchmark_data_smithi053_32461_object40843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.658320+0000", 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9994731, 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024911600000000002, 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 190159 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658320+0000", 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658320+0000", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658321+0000", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6000000000000002e-07 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658324+0000", 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9110000000000003e-06 2024-09-12T21:52:14.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658333+0000", 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7360000000000007e-06 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658339+0000", 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0390000000000001e-06 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658391+0000", 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1795000000000001e-05 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658506+0000", 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011499500000000001 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:190156 5.3 e54/21 5:c1f464ff:::benchmark_data_smithi053_32461_object40840:head v 54'12117, mlcod=54'12114)", 2024-09-12T21:52:14.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:14.658528+0000", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9992642, 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010696699999999999, 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658528+0000", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658528+0000", 2024-09-12T21:52:14.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658529+0000", 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0699999999999997e-07 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658533+0000", 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1309999999999999e-06 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:14.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658541+0000", 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4800000000000004e-06 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658545+0000", 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9169999999999997e-06 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658588+0000", 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2351999999999997e-05 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:14.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:14.658604+0000", 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6497000000000001e-05 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 13 2024-09-12T21:52:14.713 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:14.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:14.715 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:14.713+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:14.815 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:14.814+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:14.900 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:14.900 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:14.900 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:14.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:14.916 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:14.915+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:15.018 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:15.016+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:15.109 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:15.109 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.795817906000003, 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:15.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:15.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:15.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.794196511000003, 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.116 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:15.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:15.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.794106481999997, 2024-09-12T21:52:15.122 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.123 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:15.124 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:15.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:15.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.790934780999997, 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:15.133 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.790414525999999, 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.135 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:15.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.139 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:15.140 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.783831040000003, 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.142 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.143 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.144 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:15.145 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 53.771221228000002, 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.147 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.148 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.149 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:15.150 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:15.151 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.152 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.153 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5979750799999994, 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:15.155 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:15.156 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.157 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.158 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:15.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.160 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5954243169999991, 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.161 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.162 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.163 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.164 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:15.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.166 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5928486300000007, 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.168 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.169 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:15.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.171 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:15.172 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.173 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.174 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5906614080000008, 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.176 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:15.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:15.178 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.179 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.180 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:15.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5855727809999998, 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.182 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:15.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:15.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:15.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5743994949999998, 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:15.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:15.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5706062169999999, 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.198 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.200 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:15.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.204 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5628121700000008, 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.205 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:15.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:15.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:15.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:15.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5311854149999995, 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:15.212 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:15.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:15.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:15.219 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5123259069999992, 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:15.222 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.223 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:15.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5075318820000003, 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.227 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:15.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:15.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.233 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.5062277369999997, 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:15.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:15.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:15.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.4962750020000009, 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:15.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:15.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:15.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:15.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.247 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:15.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:15.248 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:15.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:15.250 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:15.248+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:15.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:15.350 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:15.348+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192577 5.b 5:d3f0d648:::benchmark_data_smithi053_32461_object43261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400076+0000", 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00184637, 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001868307, 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192577 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400076+0000", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400076+0000", 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400077+0000", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3799999999999996e-07 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400080+0000", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7870000000000002e-06 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400086+0000", 2024-09-12T21:52:15.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6489999999999996e-06 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400089+0000", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400171+0000", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1874999999999998e-05 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400288+0000", 2024-09-12T21:52:15.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117081 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192578 5.0 5:08fb2ce5:::benchmark_data_smithi053_32461_object43262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400352+0000", 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015709879999999999, 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016639129999999999, 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192578 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400352+0000", 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400352+0000", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400353+0000", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1800000000000005e-07 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400364+0000", 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400374+0000", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9879999999999999e-06 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400381+0000", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9689999999999997e-06 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401302+0000", 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000921038 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401415+0000", 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113097 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192579 5.0 5.a55aaec0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400401+0000", 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015219910000000001, 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016761549999999999, 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192579 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400401+0000", 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400401+0000", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400401+0000", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0900000000000001e-07 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400404+0000", 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9510000000000002e-06 2024-09-12T21:52:15.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400411+0000", 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.058e-06 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400417+0000", 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192580 5.b 5.54b4fbeb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400424+0000", 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014985420000000001, 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017005130000000001, 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192580 2024-09-12T21:52:15.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400424+0000", 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400424+0000", 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400425+0000", 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3799999999999998e-07 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400427+0000", 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0700000000000001e-06 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400433+0000", 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400438+0000", 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9400000000000001e-06 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192581 5.3 5:cf6a4c6b:::benchmark_data_smithi053_32461_object43265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400452+0000", 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001470723, 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017246690000000001, 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192581 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400452+0000", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400452+0000", 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400452+0000", 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7999999999999996e-07 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400455+0000", 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5500000000000001e-06 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400462+0000", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9149999999999999e-06 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400468+0000", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.959e-06 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.402039+0000", 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001571153 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.402147+0000", 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107546 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192582 5.e 5:74f77c26:::benchmark_data_smithi053_32461_object43266:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400608+0000", 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001315082, 2024-09-12T21:52:15.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001628303, 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192582 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400608+0000", 2024-09-12T21:52:15.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400608+0000", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400609+0000", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0470000000000001e-06 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400612+0000", 2024-09-12T21:52:15.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5240000000000001e-06 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400621+0000", 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0569999999999999e-06 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400627+0000", 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7370000000000003e-06 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401509+0000", 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088198699999999998 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401615+0000", 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105776 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:192583 5.6 e54/36 5:66e0f1dd:::benchmark_data_smithi053_32461_object43267:head v 54'12140, mlcod=54'12137)", 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.400847+0000", 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010756069999999999, 2024-09-12T21:52:15.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014494899999999999, 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400847+0000", 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400847+0000", 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400848+0000", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999998e-07 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400853+0000", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9799999999999998e-06 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400865+0000", 2024-09-12T21:52:15.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2807e-05 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400871+0000", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3499999999999996e-06 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401205+0000", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033423200000000001 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401227+0000", 2024-09-12T21:52:15.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.211e-05 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:192584 5.1 e54/36 5:87b3d903:::benchmark_data_smithi053_32461_object43268:head v 54'11948, mlcod=54'11946)", 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.401233+0000", 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00068992000000000001, 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011161610000000001, 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401233+0000", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401233+0000", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401233+0000", 2024-09-12T21:52:15.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9400000000000005e-07 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401238+0000", 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4710000000000001e-06 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401247+0000", 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0350000000000007e-06 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401253+0000", 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8950000000000003e-06 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401314+0000", 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1532999999999995e-05 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.401334+0000", 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9964999999999999e-05 2024-09-12T21:52:15.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192569 5.8 5:190f07c9:::benchmark_data_smithi053_32461_object43253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.397280+0000", 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046425420000000004, 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051252909999999997, 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192569 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397280+0000", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397280+0000", 2024-09-12T21:52:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397281+0000", 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6499999999999999e-07 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397284+0000", 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4620000000000001e-06 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397297+0000", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2405000000000001e-05 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397302+0000", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1089999999999997e-06 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397360+0000", 2024-09-12T21:52:15.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8017999999999999e-05 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397470+0000", 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011048300000000001 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192570 5.e 5:7ee80261:::benchmark_data_smithi053_32461_object43254:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.397320+0000", 2024-09-12T21:52:15.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046028129999999999, 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051443909999999999, 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192570 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397320+0000", 2024-09-12T21:52:15.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397320+0000", 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397320+0000", 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3099999999999998e-07 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397322+0000", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.041e-06 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397329+0000", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397332+0000", 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3189999999999999e-06 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399090+0000", 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001757404 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399275+0000", 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018514599999999999 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192571 5.3 5:c9a0903b:::benchmark_data_smithi053_32461_object43255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.397337+0000", 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045857349999999996, 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051864989999999998, 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192571 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397337+0000", 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397337+0000", 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397337+0000", 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-07 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397339+0000", 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.387e-06 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397342+0000", 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.394e-06 2024-09-12T21:52:15.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397345+0000", 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397391+0000", 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6288999999999997e-05 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397493+0000", 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101643 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397591+0000", 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8527e-05 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399775+0000", 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002183993 2024-09-12T21:52:15.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:192572 5.6 e54/36 5:6144f13a:::benchmark_data_smithi053_32461_object43256:head v 54'12139, mlcod=54'12136)", 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.397680+0000", 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042425040000000002, 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049122990000000002, 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.449 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397680+0000", 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397680+0000", 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397681+0000", 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000000000000001e-07 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397684+0000", 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.145e-06 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397689+0000", 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2190000000000003e-06 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.397692+0000", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.055e-06 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398366+0000", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067363600000000003 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398388+0000", 2024-09-12T21:52:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2359999999999999e-05 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192574 5.3 5:cf9bda18:::benchmark_data_smithi053_32461_object43258:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.398032+0000", 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038907170000000001, 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046131810000000001, 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192574 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398032+0000", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398032+0000", 2024-09-12T21:52:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398033+0000", 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7700000000000004e-07 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398036+0000", 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.551e-06 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398044+0000", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6890000000000004e-06 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398050+0000", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0979999999999999e-06 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399802+0000", 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001751914 2024-09-12T21:52:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399929+0000", 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012671500000000001 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400036+0000", 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107491 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192575 5.8 5:171970ef:::benchmark_data_smithi053_32461_object43259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.398065+0000", 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003857418, 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046441980000000004, 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192575 2024-09-12T21:52:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398065+0000", 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398065+0000", 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398066+0000", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2499999999999995e-07 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398068+0000", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3649999999999998e-06 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398074+0000", 2024-09-12T21:52:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2809999999999997e-06 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398079+0000", 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8069999999999999e-06 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400833+0000", 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027534590000000002 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.400955+0000", 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012205 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:192576 5.0 5:038da447:::benchmark_data_smithi053_32461_object43260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:15.398114+0000", 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003808568, 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046577989999999998, 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 192576 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398114+0000", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398114+0000", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398115+0000", 2024-09-12T21:52:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6499999999999999e-07 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398118+0000", 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.213e-06 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398125+0000", 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0520000000000004e-06 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.398130+0000", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1170000000000003e-06 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399330+0000", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011997970000000001 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:15.399461+0000", 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013079399999999999 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-09-12T21:52:15.467 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:15.468 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:15.469 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:15.466+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:15.471 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:15.471 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:15.491 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:15.494 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:15.494 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:15.569 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:15.567+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:15.621 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:15.621 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:15.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:15.669 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:15.668+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:15.770 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:15.769+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:15.789 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:15.789 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:15.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:15.871 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:15.870+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:15.954 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:15.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:16.010 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.009+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.074 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.072+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.111 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:16.111 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:16.124 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:16.209 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.207+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.275 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.273+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.313 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:16.313 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:16.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:16.376 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.374+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.478 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:16.476+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:16.482 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:16.483 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:16.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:16.580 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:16.579+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:16.678 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.677+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.689 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:16.689 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:16.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:16.779 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.777+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.880 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.878+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:16.898 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:16.899 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:16.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:16.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-09-12T21:52:16.981 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:16.979+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:17.060 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:17.061 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:17.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:17.113 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:17.112+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:17.182 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.181+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:17.257 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:17.258 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:17.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:17.313 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:17.311+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:17.385 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.384+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:17.417 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:17.417 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:17.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:17.486 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.484+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:17.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:17.543 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:52:17.586 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:17.584+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:17.588 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:17.588 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:17.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:17.625 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:17.626 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:17.645 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:17.645 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:17.645 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:17.649 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:17.649 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:17.686 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:17.685+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:17.787 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.786+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:17.790 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:17.791 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:17.791 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:17.791 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:17.791 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:17.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:17.889 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.887+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:17.989 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:17.987+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.002 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:18.002 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:18.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.659748629000006, 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.658427102999994, 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:18.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:18.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:18.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.657939260000006, 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:18.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.657211879000002, 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:18.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:18.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:18.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.690367827999999, 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:18.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.690240369000001, 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:18.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:18.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.690181748999997, 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.688070103000001, 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:18.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:18.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:18.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.686413160999997, 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:18.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.685463562000002, 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:18.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:18.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.681239474999998, 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:18.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:18.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:18.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.678885936999997, 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:18.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.677262745, 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3179167249999999, 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3161999360000003, 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.315461129, 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3154254200000004, 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3111273140000002, 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3072475890000002, 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3049971659999997, 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.125 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:18.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:18.126 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:18.115+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:18.218 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:18.217+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.278 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:18.278 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:18.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201500 5.f 5:f406035a:::benchmark_data_smithi053_32461_object52184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.274086+0000", 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0033310369999999998, 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003359056, 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201500 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.279 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274086+0000", 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274086+0000", 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274087+0000", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4900000000000005e-07 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274092+0000", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3429999999999998e-06 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274104+0000", 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2475e-05 2024-09-12T21:52:18.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.274111+0000", 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9290000000000001e-06 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275353+0000", 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012423009999999999 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275508+0000", 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015485100000000001 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201502 5.9 5:94397043:::benchmark_data_smithi053_32461_object52186:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.275395+0000", 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0020221200000000001, 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021243249999999998, 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:18.283 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201502 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275395+0000", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275395+0000", 2024-09-12T21:52:18.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275396+0000", 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8599999999999997e-07 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275400+0000", 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3030000000000001e-06 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275988+0000", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000587299 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275997+0000", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.149e-06 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276101+0000", 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103811 2024-09-12T21:52:18.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276519+0000", 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00041859699999999999 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:201493 5.c e55/21 5:39286280:::benchmark_data_smithi053_32461_object52177:head v 55'12447, mlcod=55'12444)", 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.276089+0000", 2024-09-12T21:52:18.287 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00132879, 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0014963870000000001, 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276089+0000", 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276089+0000", 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276089+0000", 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2599999999999998e-07 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276093+0000", 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.16e-06 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276099+0000", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2899999999999999e-06 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276103+0000", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4450000000000001e-06 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276133+0000", 2024-09-12T21:52:18.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0419000000000001e-05 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276150+0000", 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7013000000000001e-05 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201504 5.d 5:b2ff4dec:::benchmark_data_smithi053_32461_object52188:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.276400+0000", 2024-09-12T21:52:18.292 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010171920000000001, 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00124456, 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201504 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276400+0000", 2024-09-12T21:52:18.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276400+0000", 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276401+0000", 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276403+0000", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.492e-06 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276415+0000", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1559999999999999e-05 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276422+0000", 2024-09-12T21:52:18.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9940000000000003e-06 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276492+0000", 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0099999999999996e-05 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276635+0000", 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000143213 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.296 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201505 5.9 5.6f32d849 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.276439+0000", 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00097847100000000007, 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001269671, 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201505 2024-09-12T21:52:18.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276439+0000", 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276439+0000", 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276439+0000", 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.82e-07 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276442+0000", 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9390000000000002e-06 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276450+0000", 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4420000000000001e-06 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276455+0000", 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1490000000000002e-06 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201507 5.7 5:ecd98d5d:::benchmark_data_smithi053_32461_object52191:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.276465+0000", 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00095260799999999997, 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0012981220000000001, 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.300 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201507 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276465+0000", 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276465+0000", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276465+0000", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5999999999999999e-07 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276468+0000", 2024-09-12T21:52:18.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4159999999999998e-06 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276474+0000", 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.46e-06 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276480+0000", 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4790000000000004e-06 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276580+0000", 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010043 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276750+0000", 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000170089 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276857+0000", 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000106754 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201508 5.7 5.91c745e7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.276489+0000", 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00092817300000000002, 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013131600000000001, 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201508 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276489+0000", 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276489+0000", 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276490+0000", 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.15e-07 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276492+0000", 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.216e-06 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276498+0000", 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1210000000000003e-06 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.276503+0000", 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099999999999997e-06 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:201483 5.7 5:ed81b69d:::benchmark_data_smithi053_32461_object52167:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:18.269885+0000", 2024-09-12T21:52:18.308 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0075328690000000002, 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079466320000000003, 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 201483 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269885+0000", 2024-09-12T21:52:18.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269885+0000", 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269885+0000", 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1300000000000001e-07 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269887+0000", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2879999999999999e-06 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269895+0000", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6320000000000008e-06 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.269900+0000", 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0350000000000001e-06 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.272676+0000", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002775783 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.272794+0000", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118269 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.272905+0000", 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110709 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:18.275418+0000", 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0025131609999999999 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 8 2024-09-12T21:52:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:18.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:18.319 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:18.318+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.419 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:18.418+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:18.460 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:18.460 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:18.460 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:18.460 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:18.460 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:18.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:18.520 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:18.519+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.529 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:52:18.621 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:18.620+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.667 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:18.667 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:18.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.353825022999999, 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.668 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:18.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:18.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:18.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.674 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.352203627999998, 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:18.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:18.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:18.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.680 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.352113598999999, 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.681 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:18.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:18.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.348941898, 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:18.690 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.691 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:18.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:18.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.348421643000002, 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.695 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:18.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.700 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.341838156999998, 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.701 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 57.329228344999997, 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:18.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.155982197, 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.153431434, 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:18.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:18.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:18.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:18.726 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.150855747, 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:18.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:18.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:18.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:18.733 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.148668525, 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:18.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:18.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:18.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:18.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.739 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.143579898, 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:18.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.132406612, 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.747 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:18.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.753 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.128613334000001, 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:18.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:18.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.758 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:18.759 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.120819287, 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.761 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:18.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.765 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.089192532, 2024-09-12T21:52:18.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:18.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.070333024, 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:18.775 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:18.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:18.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.065538998999999, 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.782 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.783 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:18.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:18.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.788 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.064234854, 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.789 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:18.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 13.054282119, 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.796 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:18.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:18.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:18.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:18.802 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:18.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:18.804 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:18.802+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:18.906 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:18.904+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203637 5.5 5:a53f0068:::benchmark_data_smithi053_32461_object54321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.952807+0000", 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046100860000000002, 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046416390000000004, 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203637 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952807+0000", 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952807+0000", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952808+0000", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1900000000000002e-07 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952812+0000", 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5870000000000001e-06 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952821+0000", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3929999999999997e-06 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.952827+0000", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4710000000000004e-06 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954017+0000", 2024-09-12T21:52:18.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011892389999999999 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954119+0000", 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010199700000000001 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954216+0000", 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7262999999999994e-05 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957273+0000", 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030572220000000001 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957425+0000", 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151984 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203639 5.b 5:df69747d:::benchmark_data_smithi053_32461_object54323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.953736+0000", 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036814259999999998, 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037989059999999999, 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203639 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953736+0000", 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953736+0000", 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953736+0000", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4799999999999998e-07 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953739+0000", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6690000000000002e-06 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953747+0000", 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7600000000000002e-06 2024-09-12T21:52:18.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953753+0000", 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7470000000000002e-06 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954670+0000", 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091765599999999998 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954743+0000", 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2784e-05 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203643 5.c 5:316304ab:::benchmark_data_smithi053_32461_object54327:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.953792+0000", 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036251230000000001, 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038044329999999999, 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203643 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953792+0000", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953792+0000", 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953793+0000", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.15e-07 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953795+0000", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.21e-06 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953801+0000", 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1689999999999997e-06 2024-09-12T21:52:18.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953806+0000", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953845+0000", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8995999999999997e-05 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.953963+0000", 2024-09-12T21:52:18.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117611 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954070+0000", 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107587 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956081+0000", 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020105570000000001 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203644 5.5 5:a3b498ac:::benchmark_data_smithi053_32461_object54328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.954726+0000", 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026914909999999998, 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002940818, 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203644 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954726+0000", 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954726+0000", 2024-09-12T21:52:18.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954727+0000", 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8999999999999995e-07 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954731+0000", 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7119999999999999e-06 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954742+0000", 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0718e-05 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.954749+0000", 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8390000000000001e-06 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.955664+0000", 2024-09-12T21:52:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091522000000000001 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.955747+0000", 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2410999999999994e-05 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.955851+0000", 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104625 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:18.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957627+0000", 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001775715 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203647 5.c 5:36a8fbe6:::benchmark_data_smithi053_32461_object54331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.956372+0000", 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010456090000000001, 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001365326, 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203647 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956372+0000", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956372+0000", 2024-09-12T21:52:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956373+0000", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0130000000000001e-06 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956377+0000", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1629999999999998e-06 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956397+0000", 2024-09-12T21:52:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.033e-05 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956406+0000", 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7269999999999996e-06 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956443+0000", 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7492e-05 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956514+0000", 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0147000000000004e-05 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956576+0000", 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2205999999999994e-05 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203649 5.b 5:dee29b85:::benchmark_data_smithi053_32461_object54333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.956555+0000", 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00086182000000000001, 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012449939999999999, 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203649 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956555+0000", 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956555+0000", 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956556+0000", 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8100000000000001e-07 2024-09-12T21:52:18.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956560+0000", 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9530000000000001e-06 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956571+0000", 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0606e-05 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956578+0000", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.883e-06 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956622+0000", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4495e-05 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956768+0000", 2024-09-12T21:52:18.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014598700000000001 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203650 5.2 5:420006cb:::benchmark_data_smithi053_32461_object54334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.956593+0000", 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00082390199999999995, 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012730969999999999, 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203650 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956593+0000", 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956593+0000", 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956594+0000", 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3300000000000002e-07 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956596+0000", 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.311e-06 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956603+0000", 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8709999999999999e-06 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956608+0000", 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2399999999999998e-06 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956670+0000", 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1684000000000001e-05 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956782+0000", 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011216 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956896+0000", 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113724 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:203643 5.c e56/21)", 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.956651+0000", 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00076638100000000001, 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001274645, 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956651+0000", 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956651+0000", 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956651+0000", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000000000000001e-07 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956654+0000", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7269999999999999e-06 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956662+0000", 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956668+0000", 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6790000000000002e-06 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:203646 5.6 e56/36 5:64ea42ba:::benchmark_data_smithi053_32461_object54330:head v 56'12807, mlcod=56'12805)", 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.956700+0000", 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071746199999999998, 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012722129999999999, 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:18.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956700+0000", 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956700+0000", 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:18.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956700+0000", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6100000000000001e-07 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956705+0000", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5990000000000004e-06 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956713+0000", 2024-09-12T21:52:18.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7689999999999996e-06 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956718+0000", 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4790000000000004e-06 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956770+0000", 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2287000000000003e-05 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.956792+0000", 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1934e-05 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:203651 5.e 5:7cb71b86:::benchmark_data_smithi053_32461_object54335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:18.957444+0000", 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999738, 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000582761, 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 203651 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957444+0000", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957444+0000", 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957444+0000", 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1200000000000003e-07 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957447+0000", 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9050000000000001e-06 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957455+0000", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3750000000000003e-06 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957462+0000", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7549999999999997e-06 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957529+0000", 2024-09-12T21:52:19.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6814000000000001e-05 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:18.957655+0000", 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126205 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-09-12T21:52:19.004 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:19.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:19.006 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:19.004+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:19.106 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:19.105+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:19.202 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:19.202 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:19.202 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:19.202 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:19.203 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:19.207 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.206+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.215 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:19.308 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.307+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.410 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.408+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.072451143999999, 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.071129618000001, 2024-09-12T21:52:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.070641774999999, 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.069914393999994, 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.103070342999999, 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.102942884000001, 2024-09-12T21:52:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.102884263999997, 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.100772618000001, 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.099115675999997, 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.098166077000002, 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.093941989999998, 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.091588452000003, 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.08996526, 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7306192399999993, 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:19.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7289024509999997, 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:19.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7281636440000003, 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:19.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7281279349999998, 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:19.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:19.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7238298289999996, 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:19.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7199501040000005, 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:19.525 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:19.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:19.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7176996809999991, 2024-09-12T21:52:19.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:19.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:19.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:19.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:19.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:19.538 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:19.539 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:19.538+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:19.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:19.640 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.638+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:19.691 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:19.691 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205908 5.7 5:eb4ed19e:::benchmark_data_smithi053_32461_object56592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.685141+0000", 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044129499999999997, 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044363980000000003, 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205908 2024-09-12T21:52:19.692 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685141+0000", 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685141+0000", 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685142+0000", 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685145+0000", 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1530000000000001e-06 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685153+0000", 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8339999999999999e-06 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685158+0000", 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2460000000000003e-06 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.686911+0000", 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017527440000000001 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687021+0000", 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110647 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.697 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687134+0000", 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112742 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688702+0000", 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001567967 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205910 5.7 5:e22c3257:::benchmark_data_smithi053_32461_object56594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.685170+0000", 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0043838799999999997, 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0045070709999999996, 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205910 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.699 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685170+0000", 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685170+0000", 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685171+0000", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2200000000000004e-07 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685173+0000", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6520000000000002e-06 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685180+0000", 2024-09-12T21:52:19.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0870000000000001e-06 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685185+0000", 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1540000000000001e-06 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688746+0000", 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035602170000000001 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688890+0000", 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014484900000000001 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688996+0000", 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000105658 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.703 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205912 5.1 5:86ae5d05:::benchmark_data_smithi053_32461_object56596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.685399+0000", 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0041551940000000001, 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0043470339999999996, 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205912 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685399+0000", 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685399+0000", 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685399+0000", 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9899999999999999e-07 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685404+0000", 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6099999999999999e-06 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685413+0000", 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1449999999999997e-06 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685420+0000", 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.516e-06 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689024+0000", 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0036045809999999999 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689136+0000", 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111752 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689243+0000", 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107011 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.708 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205913 5.f 5:fde62900:::benchmark_data_smithi053_32461_object56597:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.685793+0000", 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0037612119999999999, 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040199759999999998, 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.709 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205913 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685793+0000", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685793+0000", 2024-09-12T21:52:19.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685793+0000", 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8800000000000002e-07 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685797+0000", 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6150000000000001e-06 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.711 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685807+0000", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5359999999999998e-06 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685812+0000", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4609999999999999e-06 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688733+0000", 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002921154 2024-09-12T21:52:19.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688850+0000", 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000116723 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205915 5.9 5:988bc410:::benchmark_data_smithi053_32461_object56599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.687425+0000", 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0021286880000000001, 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024474420000000002, 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.713 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205915 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687425+0000", 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687425+0000", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687426+0000", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687434+0000", 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4700000000000002e-06 2024-09-12T21:52:19.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687443+0000", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2409999999999995e-06 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687448+0000", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5520000000000004e-06 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689009+0000", 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001561076 2024-09-12T21:52:19.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689121+0000", 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111467 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205917 5.f 5.7792726f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.688001+0000", 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001553289, 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019292210000000001, 2024-09-12T21:52:19.717 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205917 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688001+0000", 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.718 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688001+0000", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688001+0000", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688005+0000", 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000001e-06 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688016+0000", 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0550000000000001e-05 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688022+0000", 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4169999999999997e-06 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:205916 5.c e56/21 5:3742c08c:::benchmark_data_smithi053_32461_object56600:head v 56'12721, mlcod=56'12719)", 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.688041+0000", 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0015125430000000001, 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001938354, 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688041+0000", 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688041+0000", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688042+0000", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.53e-07 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688046+0000", 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9759999999999997e-06 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688053+0000", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6170000000000001e-06 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688059+0000", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2580000000000003e-06 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688102+0000", 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3648e-05 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688121+0000", 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8967999999999999e-05 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:205918 5.2 e56/36 5:4bd37785:::benchmark_data_smithi053_32461_object56602:head v 56'12640, mlcod=56'12638)", 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.688553+0000", 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010005229999999999, 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001481759, 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.724 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688553+0000", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688553+0000", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688554+0000", 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2300000000000001e-07 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688559+0000", 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1070000000000004e-06 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688570+0000", 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0662000000000001e-05 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688575+0000", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8030000000000002e-06 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688633+0000", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8026000000000003e-05 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688652+0000", 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8244999999999999e-05 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.727 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:205907 5.1 e56/36)", 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.689448+0000", 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00010582, 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00063866499999999996, 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689448+0000", 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689448+0000", 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689449+0000", 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:19.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689453+0000", 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9099999999999998e-06 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689464+0000", 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1419e-05 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.689470+0000", 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0610000000000001e-06 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205898 5.1 5:8f8561f6:::benchmark_data_smithi053_32461_object56582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.681369+0000", 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0081849880000000007, 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0087669889999999993, 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205898 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681369+0000", 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681369+0000", 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681370+0000", 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.95e-07 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681375+0000", 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2480000000000004e-06 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681387+0000", 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.188e-05 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.681394+0000", 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.469e-06 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683099+0000", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017045630000000001 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683182+0000", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3178999999999998e-05 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683277+0000", 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5210000000000005e-05 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.686890+0000", 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003612639 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205901 5.7 5:e52dafd3:::benchmark_data_smithi053_32461_object56585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.683260+0000", 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0062939049999999998, 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0069566189999999998, 2024-09-12T21:52:19.736 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205901 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683260+0000", 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683260+0000", 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683261+0000", 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0500000000000003e-07 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683264+0000", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0910000000000001e-06 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683272+0000", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6049999999999998e-06 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683278+0000", 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9159999999999998e-06 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685171+0000", 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001892966 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685297+0000", 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012536399999999999 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685409+0000", 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011212700000000001 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.688667+0000", 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003258754 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205904 5.9 5:979f858b:::benchmark_data_smithi053_32461_object56588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.741 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.683417+0000", 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0061368990000000003, 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068708579999999997, 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205904 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683417+0000", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683417+0000", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683418+0000", 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8100000000000001e-07 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683423+0000", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6689999999999997e-06 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683440+0000", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7000999999999999e-05 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683447+0000", 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3690000000000001e-06 2024-09-12T21:52:19.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.684895+0000", 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001448586 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685188+0000", 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00029222299999999998 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205905 5.9 5:9ce47032:::benchmark_data_smithi053_32461_object56589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.683461+0000", 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0060928600000000003, 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0068925779999999999, 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205905 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.746 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683461+0000", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683461+0000", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683461+0000", 2024-09-12T21:52:19.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4999999999999998e-07 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683464+0000", 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7709999999999998e-06 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683471+0000", 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8480000000000003e-06 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.683476+0000", 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1320000000000002e-06 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.686899+0000", 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034223859999999999 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.686987+0000", 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8337000000000005e-05 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:205907 5.1 5:87f6b9b3:::benchmark_data_smithi053_32461_object56591:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:19.685101+0000", 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0044529030000000002, 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053125810000000002, 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 205907 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.750 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685101+0000", 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685101+0000", 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:19.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685102+0000", 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685106+0000", 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5519999999999998e-06 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685116+0000", 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3179999999999996e-06 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.685122+0000", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4829999999999996e-06 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.686919+0000", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001797231 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687022+0000", 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000102194 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:19.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:19.687148+0000", 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126079 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 14 2024-09-12T21:52:19.754 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:19.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:19.756 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.753+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.782 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:19.782 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:19.802 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:19.802 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:19.805 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:19.806 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:19.856 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:19.855+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:19.947 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:19.947 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:19.956 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:19.955+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:19.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:20.057 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:20.056+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:20.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:52:20.602 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:20.601+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:20.603 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:20.603 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:20.603 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:20.703 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:20.702+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:20.761 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:20.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:20.804 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:20.802+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:20.905 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:20.903+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:20.924 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:20.924 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:20.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:21.006 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:21.004+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:21.094 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.094 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.107 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:21.105+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:21.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:21.207 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:21.206+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:21.263 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.263 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:21.309 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:21.307+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:21.409 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:21.408+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:21.418 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.419 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:21.513 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:21.512+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:52:21.611 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:21.610+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:21.616 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.616 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:21.711 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:21.710+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:21.784 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.784 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:21.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:21.812 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:21.811+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:21.914 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:21.912+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:21.934 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:21.935 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:21.952 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:21.952 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:21.954 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:21.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:21.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:21.965 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:22.014 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:22.012+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:22.114 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:22.114+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.820275464000005, 2024-09-12T21:52:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:22.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:22.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:22.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.818953938000007, 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:22.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:22.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.818466095000005, 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:22.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.817738714000001, 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:22.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.850894662999998, 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:22.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.850767204, 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:22.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.198 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.850708584000003, 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.848596938, 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:22.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.846939996000003, 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:22.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.845990397000001, 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:22.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.841766309999997, 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:22.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:22.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.839412772000003, 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:22.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.236 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.837789579999999, 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:22.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.478443560000001, 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:22.243 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:22.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:22.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.476726770999999, 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:22.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:22.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.475987964, 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:22.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:22.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:22.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:22.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.475952254999999, 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:22.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:22.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.471654149000001, 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:22.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.467774424, 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:22.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:22.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.465524001, 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:22.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:22.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.287 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:22.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:22.288 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:22.289 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:22.288+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:22.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:22.389 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:22.388+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:22.441 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214544 5.f 5:f5ec194a:::benchmark_data_smithi053_32461_object65228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.437457+0000", 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0027371280000000001, 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027649049999999998, 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214544 2024-09-12T21:52:22.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437457+0000", 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437457+0000", 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437458+0000", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6899999999999996e-07 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437463+0000", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1749999999999996e-06 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437476+0000", 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3148e-05 2024-09-12T21:52:22.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437484+0000", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1510000000000004e-06 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437884+0000", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00039935200000000001 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437985+0000", 2024-09-12T21:52:22.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101604 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214545 5.9 5:9820a929:::benchmark_data_smithi053_32461_object65229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.437499+0000", 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0026949909999999999, 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027715439999999999, 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:22.446 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214545 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437499+0000", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437499+0000", 2024-09-12T21:52:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437500+0000", 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2099999999999997e-07 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437502+0000", 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5909999999999998e-06 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437511+0000", 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8210000000000008e-06 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437517+0000", 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5060000000000001e-06 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437572+0000", 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4471000000000001e-05 2024-09-12T21:52:22.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437691+0000", 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119102 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214546 5.1 5:853ae90f:::benchmark_data_smithi053_32461_object65230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.437530+0000", 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002663969, 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027781110000000002, 2024-09-12T21:52:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214546 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437530+0000", 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437530+0000", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437531+0000", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6800000000000001e-07 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437533+0000", 2024-09-12T21:52:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4619999999999999e-06 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437553+0000", 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9593e-05 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437559+0000", 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7299999999999999e-06 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438359+0000", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00079938000000000003 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438474+0000", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115476 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438556+0000", 2024-09-12T21:52:22.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1590999999999999e-05 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214549 5.7 5:eff40fd2:::benchmark_data_smithi053_32461_object65233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.437569+0000", 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0026253420000000001, 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002787585, 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:22.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214549 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437569+0000", 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437569+0000", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437569+0000", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0399999999999996e-07 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437572+0000", 2024-09-12T21:52:22.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6220000000000001e-06 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437580+0000", 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2689999999999999e-06 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437586+0000", 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7300000000000002e-06 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439633+0000", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020469059999999998 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439752+0000", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011924199999999999 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439901+0000", 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000148768 2024-09-12T21:52:22.459 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214550 5.f 5:fe2ff275:::benchmark_data_smithi053_32461_object65234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.437597+0000", 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025968779999999999, 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028036960000000001, 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:22.460 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214550 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437597+0000", 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437597+0000", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437598+0000", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5600000000000005e-07 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437600+0000", 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6350000000000002e-06 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437608+0000", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3880000000000002e-06 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.437613+0000", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3820000000000003e-06 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439914+0000", 2024-09-12T21:52:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023008080000000001 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440031+0000", 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117416 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:214552 5.3 e57/21 5:cf2bfd71:::benchmark_data_smithi053_32461_object65236:head v 57'13666, mlcod=57'13664)", 2024-09-12T21:52:22.464 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.438278+0000", 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001915693, 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021771, 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438278+0000", 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438278+0000", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438279+0000", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.06e-07 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438284+0000", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4949999999999999e-06 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438294+0000", 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4860000000000003e-06 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438301+0000", 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8619999999999997e-06 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438443+0000", 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014214800000000001 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.438463+0000", 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0429e-05 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440453+0000", 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001989644 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214554 5.f 5.4f0d2e7f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.468 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.439444+0000", 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00075024200000000003, 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001057896, 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214554 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439444+0000", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439444+0000", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439445+0000", 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4199999999999995e-07 2024-09-12T21:52:22.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439448+0000", 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4070000000000002e-06 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439456+0000", 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0620000000000001e-06 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439462+0000", 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480000000000004e-06 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214556 5.1 5:8c920174:::benchmark_data_smithi053_32461_object65240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.439665+0000", 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00052950800000000004, 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00089578699999999999, 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.472 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214556 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439665+0000", 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439665+0000", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439665+0000", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4300000000000002e-07 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439669+0000", 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9179999999999996e-06 2024-09-12T21:52:22.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439678+0000", 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8820000000000007e-06 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439684+0000", 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3319999999999997e-06 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.439991+0000", 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000307032 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440070+0000", 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9028000000000003e-05 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440168+0000", 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.7107000000000004e-05 2024-09-12T21:52:22.476 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214557 5.d 5:bf464e9b:::benchmark_data_smithi053_32461_object65241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.440054+0000", 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00013960599999999999, 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00058023799999999996, 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.477 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214557 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440054+0000", 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440054+0000", 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440055+0000", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2500000000000004e-07 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440059+0000", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.07e-06 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440068+0000", 2024-09-12T21:52:22.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1400000000000006e-06 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440080+0000", 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1795e-05 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440123+0000", 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.261e-05 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440232+0000", 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010911700000000001 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214559 5.d 5.e1b558ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.440101+0000", 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 9.2996000000000002e-05, 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000595576, 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.481 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214559 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440101+0000", 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440101+0000", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440102+0000", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-07 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440104+0000", 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8169999999999999e-06 2024-09-12T21:52:22.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440111+0000", 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7730000000000002e-06 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440116+0000", 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1150000000000002e-06 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214560 5.7 5.974ed567 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.440676+0000", 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9995179, 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3815999999999999e-05, 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214560 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.485 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440676+0000", 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440676+0000", 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440677+0000", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440680+0000", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5209999999999998e-06 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440690+0000", 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6460000000000005e-06 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440698+0000", 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6639999999999998e-06 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:214561 5.a 5.ac1945fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:22.440715+0000", 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9994788, 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1916999999999996e-05, 2024-09-12T21:52:22.488 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 214561 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440715+0000", 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440715+0000", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440716+0000", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3799999999999997e-07 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440719+0000", 2024-09-12T21:52:22.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8389999999999998e-06 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440727+0000", 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2709999999999992e-06 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440733+0000", 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7799999999999997e-06 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:22.440779+0000", 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6428999999999999e-05 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 12 2024-09-12T21:52:22.492 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:22.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:22.494 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:22.492+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:22.595 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:22.593+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:22.638 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:22.638 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:22.638 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:22.638 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:22.638 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:22.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:22.735 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:22.733+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:22.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-09-12T21:52:22.797 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:22.795+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:22.847 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.534754659999997, 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.848 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:22.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:22.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.533133265000004, 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.854 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:22.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.858 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.533043235999997, 2024-09-12T21:52:22.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:22.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.866 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.529871534999998, 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.867 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:22.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:22.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.52935128, 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:22.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:22.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.522767794000004, 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 61.510157982000003, 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:22.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:22.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.336911833999999, 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:22.891 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:22.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:22.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:22.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.334361071, 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:22.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:22.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:22.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.331785384, 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.905 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:22.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:22.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.329598162, 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.912 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:22.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.324509535000001, 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:22.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.313336248999999, 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:22.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:22.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.309542970999999, 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:22.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:22.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:22.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.301748924000002, 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:22.939 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:22.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:22.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.270122169, 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:22.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.952 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.251262660999998, 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:22.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:22.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.246468635999999, 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:22.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.245164491000001, 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:22.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:22.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:22.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 17.235211755999998, 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:22.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:22.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:22.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:22.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:22.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:22.981 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:22.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:22.983 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:22.981+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.084 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:23.083+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216743 5.5 5:a6f801bc:::benchmark_data_smithi053_32461_object67427:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.141458+0000", 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002756671, 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027815980000000001, 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216743 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141458+0000", 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141458+0000", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141459+0000", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0249999999999999e-06 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141463+0000", 2024-09-12T21:52:23.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0090000000000001e-06 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141472+0000", 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6640000000000004e-06 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141478+0000", 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0789999999999997e-06 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141544+0000", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6426000000000004e-05 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141680+0000", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013583200000000001 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141787+0000", 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107414 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216744 5.2 5:45b1dc9a:::benchmark_data_smithi053_32461_object67428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.141504+0000", 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027109149999999999, 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028117099999999998, 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216744 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141504+0000", 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141504+0000", 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141504+0000", 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3799999999999997e-07 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141507+0000", 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.633e-06 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141514+0000", 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9190000000000002e-06 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141519+0000", 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3140000000000003e-06 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142200+0000", 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068096300000000003 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142303+0000", 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010268300000000001 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142403+0000", 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100369 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:216745 5.a e57/51 5:5c62a641:::benchmark_data_smithi053_32461_object67429:head v 57'13286, mlcod=57'13283)", 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.141777+0000", 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024379720000000001, 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025809840000000001, 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141777+0000", 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141777+0000", 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141777+0000", 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7300000000000002e-07 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141780+0000", 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.791e-06 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141785+0000", 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5799999999999999e-06 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141789+0000", 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8909999999999997e-06 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141866+0000", 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6984999999999996e-05 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.141890+0000", 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4278999999999999e-05 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216746 5.0 5:055a5db1:::benchmark_data_smithi053_32461_object67430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.142053+0000", 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002161774, 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002341208, 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216746 2024-09-12T21:52:23.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142053+0000", 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142053+0000", 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142054+0000", 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7599999999999996e-07 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142057+0000", 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1250000000000001e-06 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142065+0000", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0479999999999999e-06 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142070+0000", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142129+0000", 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8267999999999998e-05 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142243+0000", 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114382 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216747 5.5 5:aa5fc61a:::benchmark_data_smithi053_32461_object67431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.142523+0000", 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001691344, 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001914198, 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216747 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142523+0000", 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142523+0000", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142524+0000", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1900000000000002e-07 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142528+0000", 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8179999999999997e-06 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142536+0000", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2740000000000007e-06 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.142542+0000", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143539+0000", 2024-09-12T21:52:23.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099734999999999993 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143645+0000", 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010546499999999999 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143746+0000", 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101402 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:216743 5.5 e57/21)", 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.143749+0000", 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00046527199999999997, 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00072447699999999996, 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143749+0000", 2024-09-12T21:52:23.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143749+0000", 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143750+0000", 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4999999999999999e-07 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143752+0000", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.277e-06 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143758+0000", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6799999999999998e-06 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143762+0000", 2024-09-12T21:52:23.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0439999999999997e-06 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216751 5.2 5:47786c29:::benchmark_data_smithi053_32461_object67435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.143920+0000", 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00029422699999999999, 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00057851199999999999, 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216751 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143920+0000", 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143920+0000", 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143921+0000", 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.02e-07 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143925+0000", 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9700000000000001e-06 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143989+0000", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4177000000000006e-05 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.143996+0000", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4819999999999999e-06 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144267+0000", 2024-09-12T21:52:23.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027117599999999998 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144395+0000", 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012840599999999999 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144502+0000", 2024-09-12T21:52:23.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106446 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:216741 5.2 e57/36)", 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.144038+0000", 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00017623500000000001, 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000496839, 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:23.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144038+0000", 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144038+0000", 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144039+0000", 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2899999999999999e-07 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144041+0000", 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2050000000000001e-06 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144053+0000", 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144058+0000", 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3700000000000003e-06 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:216748 5.1 e57/36 5:88795524:::benchmark_data_smithi053_32461_object67432:head v 57'13466, mlcod=57'13464)", 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.144279+0000", 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999356, 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028359799999999998, 2024-09-12T21:52:23.181 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144279+0000", 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144279+0000", 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144280+0000", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6599999999999996e-07 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144285+0000", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144293+0000", 2024-09-12T21:52:23.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2269999999999993e-06 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144298+0000", 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4790000000000004e-06 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144339+0000", 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0655000000000003e-05 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144358+0000", 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9252000000000001e-05 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:216749 5.a e57/51)", 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.144318+0000", 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998965, 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027401999999999998, 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144318+0000", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144318+0000", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144319+0000", 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9700000000000002e-07 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144322+0000", 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3869999999999999e-06 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144328+0000", 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4509999999999997e-06 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144333+0000", 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6600000000000003e-06 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216753 5.0 5:0c27d6bc:::benchmark_data_smithi053_32461_object67437:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.144362+0000", 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998522, 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025545199999999998, 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216753 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144362+0000", 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144362+0000", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144363+0000", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.54e-07 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144366+0000", 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9960000000000002e-06 2024-09-12T21:52:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144374+0000", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5599999999999996e-06 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144379+0000", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3569999999999997e-06 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144423+0000", 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4073999999999998e-05 2024-09-12T21:52:23.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144532+0000", 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108854 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216754 5.8 5.30b84998 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.144391+0000", 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998236, 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026033399999999998, 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216754 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144391+0000", 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144391+0000", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144392+0000", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3099999999999998e-07 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144394+0000", 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.34e-06 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144400+0000", 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5250000000000002e-06 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.144406+0000", 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9390000000000002e-06 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:216741 5.2 5:4628e8ed:::benchmark_data_smithi053_32461_object67425:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:23.139659+0000", 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045552140000000001, 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050211819999999999, 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216741 2024-09-12T21:52:23.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139659+0000", 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139659+0000", 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139660+0000", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.32e-07 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139662+0000", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0140000000000001e-06 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139668+0000", 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0800000000000002e-06 2024-09-12T21:52:23.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139673+0000", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.215e-06 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139736+0000", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2504999999999999e-05 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139839+0000", 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103768 2024-09-12T21:52:23.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:23.139949+0000", 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001093 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-09-12T21:52:23.200 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:23.201 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:23.200+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.202 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:23.303 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:23.302+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:23.401 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:23.401 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:23.401 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:23.402 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:23.402 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:23.404 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:23.402+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:23.505 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:23.503+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:23.558 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:52:23.606 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:23.604+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269389876000005, 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.268068349999993, 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.267580507000005, 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.266853126000001, 2024-09-12T21:52:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.300009074999998, 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.299881616, 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.299822996000003, 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.29771135, 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.296054408000003, 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.295104809000001, 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.290880721999997, 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.288527184000003, 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.286903991999999, 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.927557972000001, 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.925841182999999, 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.925102376, 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.925066666999999, 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.920768560999999, 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.916888836, 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.914638413, 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:23.736 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:23.737 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:23.735+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:23.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:23.838 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:23.837+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:219039 5.5 e57/21 5:a04cd09e:::benchmark_data_smithi053_32461_object69723:head v 57'13596, mlcod=57'13593)", 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.879376+0000", 2024-09-12T21:52:23.883 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0029873780000000002, 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030094560000000002, 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879376+0000", 2024-09-12T21:52:23.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879376+0000", 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879377+0000", 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3099999999999997e-07 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879386+0000", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5329999999999994e-06 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879395+0000", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5889999999999992e-06 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.879402+0000", 2024-09-12T21:52:23.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9779999999999999e-06 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880773+0000", 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013710910000000001 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880789+0000", 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6177000000000001e-05 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.887 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:219045 5.7 5:ea947dfc:::benchmark_data_smithi053_32461_object69729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.880941+0000", 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001422642, 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00151118, 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:23.888 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 219045 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880941+0000", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880941+0000", 2024-09-12T21:52:23.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880942+0000", 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3099999999999996e-07 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880946+0000", 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9129999999999996e-06 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.890 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880952+0000", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0000000000000002e-06 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880956+0000", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2729999999999996e-06 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881002+0000", 2024-09-12T21:52:23.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6029000000000003e-05 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881132+0000", 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012955 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881258+0000", 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012623800000000001 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:219046 5.a 5:5fc89ccb:::benchmark_data_smithi053_32461_object69730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.880976+0000", 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013882390000000001, 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001544826, 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 219046 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880976+0000", 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880976+0000", 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880976+0000", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2399999999999999e-07 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880978+0000", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.0849999999999999e-06 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880983+0000", 2024-09-12T21:52:23.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.485e-06 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880988+0000", 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4340000000000002e-06 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881023+0000", 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5505e-05 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881141+0000", 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000117627 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881248+0000", 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010747900000000001 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:219047 5.9 5:99b2c843:::benchmark_data_smithi053_32461_object69731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.880996+0000", 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0013677019999999999, 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015903619999999999, 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 219047 2024-09-12T21:52:23.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880996+0000", 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880996+0000", 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880996+0000", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5199999999999998e-07 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.880999+0000", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5849999999999998e-06 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881005+0000", 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9850000000000003e-06 2024-09-12T21:52:23.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881010+0000", 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4589999999999997e-06 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881052+0000", 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1740999999999999e-05 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881168+0000", 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011534100000000001 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:219048 5.1 5:8acb7846:::benchmark_data_smithi053_32461_object69732:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.881229+0000", 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0011348199999999999, 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001419364, 2024-09-12T21:52:23.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 219048 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881229+0000", 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881229+0000", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881230+0000", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9299999999999998e-07 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881233+0000", 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1420000000000002e-06 2024-09-12T21:52:23.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881240+0000", 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1149999999999996e-06 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881245+0000", 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4249999999999997e-06 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881493+0000", 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024769499999999998 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881605+0000", 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011242400000000001 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881717+0000", 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111971 2024-09-12T21:52:23.906 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:219037 5.c e57/21 5:32ecde90:::benchmark_data_smithi053_32461_object69721:head v 57'13563, mlcod=57'13558)", 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:23.881843+0000", 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000520299, 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00087017099999999999, 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881843+0000", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881843+0000", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881844+0000", 2024-09-12T21:52:23.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1900000000000002e-07 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881849+0000", 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.746e-06 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881859+0000", 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0237e-05 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881866+0000", 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7440000000000001e-06 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881911+0000", 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5645000000000001e-05 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:23.881929+0000", 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7102e-05 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:23.911 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 6 2024-09-12T21:52:23.911 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:23.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:23.952 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:23.951+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:23.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:24.040 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.038+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:24.085 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:24.086 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:24.098 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:24.098 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:24.106 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:24.106 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:24.106 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:24.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:24.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:24.111 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:24.141 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:24.139+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:24.241 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.240+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:24.295 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:24.296 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:24.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:24.349 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.348+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:24.443 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.441+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:24.470 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:24.470 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:24.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:24.543 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:24.541+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:24.544 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:52:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:24.645 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:24.642+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:24.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:24.744 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:24.742+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:24.846 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.844+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:24.847 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:24.847 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:24.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:24.947 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:24.945+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.012 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.012 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:25.064 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.063+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.148 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.146+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.211 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.211 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:25.249 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:25.247+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:25.351 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.349+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.414 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.414 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:25.468 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.467+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.551 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.549+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.586 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.586 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:25.652 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.650+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.750 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.750 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.753 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.752+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:25.763 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:25.855 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:25.852+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:25.917 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:25.917 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:25.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:25.973 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:25.972+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.056 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:26.054+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:26.081 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:26.081 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:26.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:26.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:26.157 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:26.155+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:26.236 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:26.237 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:26.255 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:26.256 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:26.256 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:26.258 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.256+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.259 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:26.259 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:26.286 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:26.286 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:26.287 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:26.287 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:26.287 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:26.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:26.381 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.380+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.460 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.458+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.175927986999994, 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:26.489 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:26.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.495 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.174306591999994, 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:26.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:26.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.501 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.174216563000002, 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:26.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:26.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:26.507 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.171044862000002, 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.508 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:26.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:26.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.170524607000004, 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.514 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:26.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.163941120999993, 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.520 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:26.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 65.151331309, 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:26.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:26.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:26.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.978085160999999, 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.532 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.533 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:26.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:26.538 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.975534398000001, 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.539 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:26.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.542 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:26.543 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.545 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.972958711, 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:26.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:26.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:26.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.552 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.970771489000001, 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.553 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:26.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:26.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.965682862000001, 2024-09-12T21:52:26.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:26.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:26.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:26.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.564 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:26.565 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.954509576, 2024-09-12T21:52:26.566 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:26.568 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.569 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.570 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:26.571 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:26.572 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.950716298, 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.573 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.574 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.575 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:26.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.577 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.578 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.579 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.942922250999999, 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.580 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.581 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.582 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.586 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.911295496000001, 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:26.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:26.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.593 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.892435987999999, 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.594 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.595 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:26.596 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:26.597 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:26.598 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.599 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.887641963, 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.600 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.601 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.602 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:26.603 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.604 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.605 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.886337818000001, 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.607 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:26.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:26.609 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.610 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.611 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 20.876385082999999, 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:26.613 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:26.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:26.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:26.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:26.620 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:26.620 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:26.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:26.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:26.622 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.619+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.722 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.720+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227964 5.5 5:a626f2e0:::benchmark_data_smithi053_32461_object78648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.774981+0000", 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065716220000000001, 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065880950000000004, 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227964 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.774981+0000", 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.774981+0000", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.774982+0000", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7599999999999996e-07 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.774986+0000", 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2370000000000003e-06 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.774997+0000", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0944000000000001e-05 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.775003+0000", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4030000000000004e-06 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.776293+0000", 2024-09-12T21:52:26.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001289945 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.776439+0000", 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146176 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.776540+0000", 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100188 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:26.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778588+0000", 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020488110000000002 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227972 5.2 5:4542ef7c:::benchmark_data_smithi053_32461_object78656:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.778625+0000", 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029270350000000001, 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029905420000000001, 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227972 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778625+0000", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778625+0000", 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778626+0000", 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9800000000000003e-07 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778630+0000", 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6990000000000001e-06 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778640+0000", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8390000000000002e-06 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778646+0000", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7359999999999998e-06 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778702+0000", 2024-09-12T21:52:26.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6048000000000003e-05 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778826+0000", 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392800000000001 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778944+0000", 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011820300000000001 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781452+0000", 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025081869999999998 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227973 5.5 5:ad37110e:::benchmark_data_smithi053_32461_object78657:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.778910+0000", 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026429919999999998, 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027759540000000002, 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227973 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778910+0000", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778910+0000", 2024-09-12T21:52:26.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778910+0000", 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8899999999999999e-07 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778914+0000", 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.472e-06 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778922+0000", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3499999999999997e-06 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778927+0000", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3820000000000003e-06 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.778969+0000", 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1878999999999997e-05 2024-09-12T21:52:26.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779073+0000", 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103842 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779187+0000", 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113608 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227975 5.3 5:c7a1a974:::benchmark_data_smithi053_32461_object78659:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.779933+0000", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016195420000000001, 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001829153, 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227975 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779933+0000", 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779933+0000", 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779934+0000", 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3799999999999996e-07 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779938+0000", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5789999999999997e-06 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779948+0000", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0019e-05 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779955+0000", 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8179999999999998e-06 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779999+0000", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3903000000000003e-05 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780106+0000", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010731899999999999 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780377+0000", 2024-09-12T21:52:26.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027013599999999998 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227977 5.4 5:26d92c97:::benchmark_data_smithi053_32461_object78661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.779978+0000", 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015740579999999999, 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018310080000000001, 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:26.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227977 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779978+0000", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779978+0000", 2024-09-12T21:52:26.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779979+0000", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3200000000000005e-07 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779982+0000", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0709999999999999e-06 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779989+0000", 2024-09-12T21:52:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0310000000000001e-06 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.779994+0000", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4160000000000003e-06 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780031+0000", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6671000000000002e-05 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780101+0000", 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9657000000000001e-05 2024-09-12T21:52:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227980 5.5 5:aa4e8b89:::benchmark_data_smithi053_32461_object78664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.780171+0000", 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001381366, 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00167132, 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227980 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780171+0000", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780171+0000", 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780172+0000", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2099999999999995e-07 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780176+0000", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1180000000000002e-06 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780186+0000", 2024-09-12T21:52:26.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5070000000000006e-06 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780192+0000", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3829999999999997e-06 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780822+0000", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062959500000000005 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780946+0000", 2024-09-12T21:52:26.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124244 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781052+0000", 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106241 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227981 5.b 5:d4e658eb:::benchmark_data_smithi053_32461_object78665:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.780213+0000", 2024-09-12T21:52:26.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013398279999999999, 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016950209999999999, 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227981 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780213+0000", 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780213+0000", 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780213+0000", 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0800000000000004e-07 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780216+0000", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6070000000000002e-06 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780223+0000", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9650000000000002e-06 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780229+0000", 2024-09-12T21:52:26.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8660000000000002e-06 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780288+0000", 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8829000000000002e-05 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780402+0000", 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011411199999999999 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:227978 5.a e58/51 5:5524e60f:::benchmark_data_smithi053_32461_object78662:head v 58'13972, mlcod=58'13970)", 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.780824+0000", 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00072823099999999997, 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011465469999999999, 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780824+0000", 2024-09-12T21:52:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780824+0000", 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780825+0000", 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3799999999999997e-07 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780830+0000", 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780838+0000", 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3380000000000005e-06 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780844+0000", 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780899+0000", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4787000000000002e-05 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780919+0000", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0417000000000001e-05 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:227982 5.8 5:182b3637:::benchmark_data_smithi053_32461_object78666:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.780980+0000", 2024-09-12T21:52:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00057235900000000004, 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010496119999999999, 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 227982 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780980+0000", 2024-09-12T21:52:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780980+0000", 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780981+0000", 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6300000000000004e-07 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780985+0000", 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0169999999999998e-06 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.780995+0000", 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7999999999999993e-06 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781001+0000", 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5459999999999997e-06 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781048+0000", 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6567999999999999e-05 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781165+0000", 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011715299999999999 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:227964 5.5 e58/21)", 2024-09-12T21:52:26.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.781027+0000", 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00052583999999999997, 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001059003, 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781027+0000", 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781027+0000", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781027+0000", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1399999999999997e-07 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781030+0000", 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-12T21:52:26.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781037+0000", 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781042+0000", 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:227983 5.6 e58/36 5:6ba1f731:::benchmark_data_smithi053_32461_object78667:head v 58'14358, mlcod=58'14356)", 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:26.781386+0000", 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00016647600000000001, 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074216500000000003, 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781386+0000", 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781386+0000", 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781387+0000", 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1099999999999996e-07 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:26.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781390+0000", 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3670000000000001e-06 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781397+0000", 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4240000000000004e-06 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781403+0000", 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5759999999999996e-06 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781450+0000", 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7540000000000002e-05 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:26.781468+0000", 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7583000000000001e-05 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:26.829 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:52:26.830 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:26.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:26.831 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:26.829+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:26.932 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:26.929+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:26.989 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:26.990 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:27.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:27.032 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:27.031+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:27.133 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:27.132+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:27.202 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.859643066000004, 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.858321540000006, 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.857833697000004, 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.857106315999999, 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.890262265000004, 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.890134806000006, 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.890076186000002, 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.887964539999999, 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.886307598000002, 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.885357999000007, 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.881133911999996, 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.878780374000002, 2024-09-12T21:52:27.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:27.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.877157182000005, 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:27.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:27.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.517811162000001, 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:27.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:27.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.516094373000001, 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:27.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:27.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.515355566, 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:27.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:27.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:27.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.515319857000001, 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.299 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:27.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.511021751000001, 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:27.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.507142026, 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:27.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:27.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.504891603000001, 2024-09-12T21:52:27.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:27.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:27.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:27.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:27.323 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:27.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:27.325 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:27.323+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:27.426 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:27.423+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:230111 5.a 5:5321418d:::benchmark_data_smithi053_32461_object80795:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.468680+0000", 2024-09-12T21:52:27.472 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0028930179999999998, 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0029101420000000001, 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 230111 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468680+0000", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468680+0000", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468680+0000", 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5799999999999998e-07 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468684+0000", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.715e-06 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468694+0000", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0318e-05 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468701+0000", 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7730000000000002e-06 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468734+0000", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2566e-05 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468806+0000", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1985999999999998e-05 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.468867+0000", 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1613999999999997e-05 2024-09-12T21:52:27.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.470734+0000", 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018665750000000001 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:230113 5.6 5:6ad750fd:::benchmark_data_smithi053_32461_object80797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.469592+0000", 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019805249999999999, 2024-09-12T21:52:27.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0020461619999999998, 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 230113 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469592+0000", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469592+0000", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469593+0000", 2024-09-12T21:52:27.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5199999999999997e-07 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469596+0000", 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8040000000000002e-06 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469605+0000", 2024-09-12T21:52:27.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.115e-06 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469609+0000", 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.369e-06 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469646+0000", 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6905e-05 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469742+0000", 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5946999999999995e-05 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.469852+0000", 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110368 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:230115 5.5 e58/21 5:a92bc3ea:::benchmark_data_smithi053_32461_object80799:head v 58'14285, mlcod=58'14283)", 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.471016+0000", 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00055635600000000004, 2024-09-12T21:52:27.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00066116199999999997, 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471016+0000", 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471016+0000", 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471017+0000", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6100000000000001e-07 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471021+0000", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.907e-06 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471029+0000", 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8180000000000004e-06 2024-09-12T21:52:27.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471033+0000", 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1060000000000002e-06 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471064+0000", 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1315000000000001e-05 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471075+0000", 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0560999999999999e-05 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:230119 5.7 5:edaf32a6:::benchmark_data_smithi053_32461_object80803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.471505+0000", 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 6.7595999999999995e-05, 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021391199999999999, 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:27.486 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 230119 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471505+0000", 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471505+0000", 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471506+0000", 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7000000000000004e-07 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471510+0000", 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.985e-06 2024-09-12T21:52:27.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471521+0000", 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1541e-05 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471528+0000", 2024-09-12T21:52:27.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3899999999999998e-06 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471576+0000", 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8099000000000001e-05 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471695+0000", 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119423 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:230120 5.d 5:b785e1ff:::benchmark_data_smithi053_32461_object80804:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.471543+0000", 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 3.0086e-05, 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021383700000000001, 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.491 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 230120 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471543+0000", 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471543+0000", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471543+0000", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471546+0000", 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6800000000000002e-06 2024-09-12T21:52:27.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471554+0000", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0010000000000001e-06 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471559+0000", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5940000000000001e-06 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471603+0000", 2024-09-12T21:52:27.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3912000000000002e-05 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471711+0000", 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107911 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.495 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:230121 5.1 5:8edcf233:::benchmark_data_smithi053_32461_object80805:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:27.471571+0000", 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 1.8920000000000001e-06, 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000219762, 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 230121 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471571+0000", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471571+0000", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471571+0000", 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2199999999999999e-07 2024-09-12T21:52:27.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471574+0000", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2929999999999999e-06 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471578+0000", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9550000000000002e-06 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471581+0000", 2024-09-12T21:52:27.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.056e-06 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471630+0000", 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9045000000000002e-05 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:27.471751+0000", 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121878 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.499 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.500 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:27.500 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 6 2024-09-12T21:52:27.500 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:27.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:27.545 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:27.543+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:27.557 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:27.627 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:27.625+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:27.652 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:27.652 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:27.652 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:27.652 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:27.652 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:27.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:27.746 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:27.745+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:27.829 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:27.827+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:27.857 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:27.857 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:27.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:27.857 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.542553455999993, 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.858 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:27.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.864 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.540932061000007, 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.865 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:27.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.870 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.540842032, 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.871 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:27.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.537670331000001, 2024-09-12T21:52:27.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.879 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:27.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.537150076000003, 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:27.883 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:27.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.886 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.887 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:27.888 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:27.889 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.530566590000006, 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:27.890 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.891 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:27.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:27.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 66.517956777999999, 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:27.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.898 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.901 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.344710630000002, 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:27.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:27.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:27.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:27.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.342159866999999, 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.908 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:27.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.910 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:27.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.339584179999999, 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.915 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:27.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.337396957999999, 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:27.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.332308331, 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.321135044999998, 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.935 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:27.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.317341766999998, 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:27.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:27.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:27.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.309547720000001, 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:27.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:27.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.954 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.277920965, 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:27.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.259061457000001, 2024-09-12T21:52:27.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:27.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:27.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.254267431999999, 2024-09-12T21:52:27.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:27.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.252963287, 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.975 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:27.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 22.243010552000001, 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:27.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:27.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:27.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:27.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:27.988 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:27.989 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:27.987+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:27.990 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:28.090 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.088+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:28.143 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:232232 5.4 5:236a282c:::benchmark_data_smithi053_32461_object82916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:28.141554+0000", 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014512279999999999, 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014697180000000001, 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232232 2024-09-12T21:52:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141554+0000", 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141554+0000", 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141555+0000", 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.091e-06 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141560+0000", 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4020000000000004e-06 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141568+0000", 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5129999999999996e-06 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141576+0000", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6539999999999999e-06 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141626+0000", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0578999999999998e-05 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141792+0000", 2024-09-12T21:52:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016601300000000001 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:232227 5.7 e59/21 5:ea670830:::benchmark_data_smithi053_32461_object82911:head v 59'14509, mlcod=59'14507)", 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:28.141696+0000", 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013089639999999999, 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013712170000000001, 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141696+0000", 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141696+0000", 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141697+0000", 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141701+0000", 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3420000000000001e-06 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141711+0000", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0049e-05 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141720+0000", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.568e-06 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141780+0000", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9762000000000001e-05 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.141798+0000", 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8573e-05 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:232237 5.8 5:17a57ff1:::benchmark_data_smithi053_32461_object82921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:28.142076+0000", 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00092932799999999999, 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010241460000000001, 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232237 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142076+0000", 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142076+0000", 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142077+0000", 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4899999999999995e-07 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142080+0000", 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142087+0000", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0099999999999998e-06 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142092+0000", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142126+0000", 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3896999999999997e-05 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.142197+0000", 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1551999999999995e-05 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:232228 5.1 e59/36)", 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:28.143068+0000", 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999375, 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5157e-05, 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143068+0000", 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143068+0000", 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143068+0000", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5199999999999996e-07 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143074+0000", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1030000000000001e-06 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143084+0000", 2024-09-12T21:52:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0207000000000001e-05 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143089+0000", 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7359999999999998e-06 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:28.143132+0000", 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2290000000000003e-05 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 4 2024-09-12T21:52:28.160 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:28.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:28.191 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.189+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:28.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:28.292 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:28.290+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:28.317 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:28.317 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:28.317 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:28.317 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:28.317 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:28.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:28.389 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:28.407 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:28.411 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:28.411 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:28.416 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:28.414+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:28.494 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.493+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:28.496 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:28.496 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:28.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:28.595 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:28.593+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:28.631 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:28.632 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:28.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:28.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-09-12T21:52:28.696 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.694+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:28.796 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:28.797 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:28.797 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:28.795+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:28.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:28.897 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.896+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:28.998 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:28.996+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.003 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.003 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:29.099 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:29.097+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:29.169 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.169 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:29.223 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:29.221+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:29.301 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:29.299+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:29.376 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.377 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:29.402 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:29.400+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.503 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:29.501+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:52:29.582 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.582 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:29.638 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:29.637+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.705 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:29.703+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.743 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.744 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:29.840 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:29.839+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:29.907 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:29.906+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:29.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:30.008 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:30.007+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:30.109 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:30.107+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:30.155 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:30.209 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:30.208+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:30.310 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:30.308+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:30.310 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:30.310 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:30.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:30.411 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:30.409+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:30.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:30.480 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:30.480 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:30.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:30.538 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:30.537+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:52:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:30.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:30.566 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:30.612 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:30.611+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.312539758, 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.311218232000002, 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.310730389, 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.310003007999995, 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.343158957, 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.343031498000002, 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.342972877999998, 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.340861231999995, 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.339204289999998, 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.338254691000003, 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.334030604000006, 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.331677065999997, 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.330053874000001, 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.970707854, 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.968991065000001, 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.968252258, 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.968216549000001, 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.963918443000001, 2024-09-12T21:52:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.960038718, 2024-09-12T21:52:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.957788295, 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:30.777 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:30.778 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:30.777+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:30.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:30.879 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:30.877+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240420 5.6 5:69110eb2:::benchmark_data_smithi053_32461_object91104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.919435+0000", 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0056477050000000003, 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0056681170000000003, 2024-09-12T21:52:30.926 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240420 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919435+0000", 2024-09-12T21:52:30.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919435+0000", 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919435+0000", 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4099999999999998e-07 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.928 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919438+0000", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8700000000000001e-06 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919446+0000", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6820000000000003e-06 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.919450+0000", 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7179999999999998e-06 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920759+0000", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00130905 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920832+0000", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3619000000000001e-05 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920897+0000", 2024-09-12T21:52:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5067000000000006e-05 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922315+0000", 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00141778 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240426 5.a 5:527dbe78:::benchmark_data_smithi053_32461_object91110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.920289+0000", 2024-09-12T21:52:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0047938540000000002, 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048619830000000003, 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240426 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920289+0000", 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920289+0000", 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920289+0000", 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7100000000000002e-07 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920292+0000", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.57e-06 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920298+0000", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.993e-06 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920301+0000", 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3239999999999999e-06 2024-09-12T21:52:30.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920346+0000", 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4660000000000003e-05 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920478+0000", 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013186900000000001 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.920595+0000", 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011778 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924687+0000", 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004091463 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240431 5.a 5:5be6a054:::benchmark_data_smithi053_32461_object91115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.936 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.922164+0000", 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.002918852, 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030279920000000002, 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240431 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922164+0000", 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922164+0000", 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922164+0000", 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7199999999999998e-07 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922168+0000", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7349999999999998e-06 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922175+0000", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9120000000000001e-06 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922180+0000", 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6720000000000003e-06 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922215+0000", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5596999999999998e-05 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922347+0000", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013137899999999999 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.922466+0000", 2024-09-12T21:52:30.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119375 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924730+0000", 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022640910000000002 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240434 5.9 5:90645527:::benchmark_data_smithi053_32461_object91118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.923245+0000", 2024-09-12T21:52:30.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0018373370000000001, 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002000885, 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240434 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923245+0000", 2024-09-12T21:52:30.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923245+0000", 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923246+0000", 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6099999999999999e-07 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923250+0000", 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.726e-06 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923262+0000", 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2476999999999999e-05 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923268+0000", 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.015e-06 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923310+0000", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1474000000000003e-05 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.923410+0000", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100611 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.925207+0000", 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0017971269999999999 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.945 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240435 5.6 5:615ea427:::benchmark_data_smithi053_32461_object91119:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.924071+0000", 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0010112840000000001, 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001213731, 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240435 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.946 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924071+0000", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924071+0000", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924072+0000", 2024-09-12T21:52:30.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9299999999999997e-07 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924075+0000", 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.49e-06 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924083+0000", 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8650000000000001e-06 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924090+0000", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4919999999999998e-06 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924148+0000", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8459999999999999e-05 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924223+0000", 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4564e-05 2024-09-12T21:52:30.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924290+0000", 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6801e-05 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:240436 5.7 5:eea87eb7:::benchmark_data_smithi053_32461_object91120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:30.924449+0000", 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00063363500000000001, 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00087425399999999998, 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:30.950 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 240436 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924449+0000", 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924449+0000", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924449+0000", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8500000000000001e-07 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924453+0000", 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2109999999999998e-06 2024-09-12T21:52:30.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924462+0000", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2229999999999996e-06 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924468+0000", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2700000000000001e-06 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924518+0000", 2024-09-12T21:52:30.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9701999999999999e-05 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924645+0000", 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012725799999999999 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:30.924756+0000", 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111288 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:30.954 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:30.955 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 6 2024-09-12T21:52:30.955 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:30.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:30.980 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:30.979+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:31.081 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.079+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.145 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:31.145 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:31.145 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:31.145 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:31.145 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:31.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:31.200 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.198+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.282 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.281+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.354 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:31.354 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:31.354 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:31.354 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.041452281000005, 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:31.356 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:31.357 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.358 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.359 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.360 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.039830886000004, 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.361 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.362 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.363 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:31.364 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.365 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.366 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.039740856999998, 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.367 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.368 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.369 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:31.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.036569155999999, 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:31.372 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:31.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.375 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.036048901000001, 2024-09-12T21:52:31.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:31.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:31.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:31.384 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.029465415000004, 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:31.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 70.016855602999996, 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:31.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:31.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:31.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.395 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.396 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.843609454999999, 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:31.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.841058692000001, 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:31.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.838483005000001, 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:31.410 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:31.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:31.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.415 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.836295783000001, 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.417 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:31.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.831207156000001, 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:31.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.82003387, 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:31.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:31.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:31.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.816240592, 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.437 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:31.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.808446544999999, 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:31.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:31.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.450 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.776819790000001, 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:31.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:31.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.757960281999999, 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.457 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:31.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:31.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.753166257, 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:31.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:31.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.470 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.751862112000001, 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:31.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:31.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 25.741909376999999, 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:31.477 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:31.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:31.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:31.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:31.483 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:31.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:31.484 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:31.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:31.486 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.483+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.585 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.584+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.641 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242662 5.8 5:174829d3:::benchmark_data_smithi053_32461_object93346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.635826+0000", 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044366079999999999, 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044605570000000004, 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242662 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635826+0000", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635826+0000", 2024-09-12T21:52:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635827+0000", 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-07 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635829+0000", 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.216e-06 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635835+0000", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1369999999999999e-06 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635840+0000", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5630000000000002e-06 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635933+0000", 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3292000000000001e-05 2024-09-12T21:52:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.636058+0000", 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012469299999999999 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242663 5.8 5:10385115:::benchmark_data_smithi053_32461_object93347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.635846+0000", 2024-09-12T21:52:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044173830000000004, 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109410000000001, 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242663 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635846+0000", 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635846+0000", 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635846+0000", 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2500000000000001e-07 2024-09-12T21:52:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635848+0000", 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.68e-06 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635853+0000", 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6960000000000002e-06 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.635864+0000", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0259e-05 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637776+0000", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001912686 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637966+0000", 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019017099999999999 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:242661 5.1 e60/36 5:8d8c9ca3:::benchmark_data_smithi053_32461_object93345:head v 60'15076, mlcod=60'15074)", 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.637710+0000", 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025532179999999999, 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027060690000000002, 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637710+0000", 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637710+0000", 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637710+0000", 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1699999999999997e-07 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637716+0000", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3319999999999999e-06 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637724+0000", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3270000000000001e-06 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637730+0000", 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8050000000000003e-06 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637952+0000", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022169600000000001 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.637972+0000", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0483999999999999e-05 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.640026+0000", 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020540620000000002 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242665 5.0 5:08b0c141:::benchmark_data_smithi053_32461_object93349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.638181+0000", 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020820330000000001, 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002292915, 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242665 2024-09-12T21:52:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638181+0000", 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638181+0000", 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638182+0000", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638187+0000", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3409999999999996e-06 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638208+0000", 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1645999999999999e-05 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638216+0000", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1189999999999997e-06 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638345+0000", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012863100000000001 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638473+0000", 2024-09-12T21:52:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012777 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242666 5.3 5:cef98cf4:::benchmark_data_smithi053_32461_object93350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.638228+0000", 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002034592, 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023063509999999999, 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242666 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638228+0000", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638228+0000", 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638229+0000", 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3500000000000002e-07 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638231+0000", 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.508e-06 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638238+0000", 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.798e-06 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638249+0000", 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0662000000000001e-05 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638410+0000", 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016085599999999999 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638525+0000", 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115637 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638640+0000", 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011458700000000001 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242667 5.8 5:1605b8e2:::benchmark_data_smithi053_32461_object93351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.638379+0000", 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018837770000000001, 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022190729999999998, 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242667 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638379+0000", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638379+0000", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638380+0000", 2024-09-12T21:52:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2300000000000001e-07 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638382+0000", 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6079999999999998e-06 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638389+0000", 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5710000000000003e-06 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638394+0000", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7380000000000002e-06 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639977+0000", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015833519999999999 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.640091+0000", 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114022 2024-09-12T21:52:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:242669 5.a e60/51 5:52a431b5:::benchmark_data_smithi053_32461_object93353:head v 60'14940, mlcod=60'14938)", 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.638885+0000", 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001377891, 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00177001, 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638885+0000", 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638885+0000", 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638886+0000", 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5700000000000002e-07 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638891+0000", 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638900+0000", 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638916+0000", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5996000000000001e-05 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638957+0000", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0951000000000001e-05 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.638975+0000", 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7999000000000002e-05 2024-09-12T21:52:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242671 5.4 5:26bf61b3:::benchmark_data_smithi053_32461_object93355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.639241+0000", 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010221379999999999, 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001468626, 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242671 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639241+0000", 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639241+0000", 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639242+0000", 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639245+0000", 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.41e-06 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639255+0000", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5070000000000006e-06 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639261+0000", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1419999999999998e-06 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639314+0000", 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3301999999999999e-05 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639452+0000", 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013819400000000001 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:242674 5.3 5:c27314a6:::benchmark_data_smithi053_32461_object93358:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.639757+0000", 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00050596400000000002, 2024-09-12T21:52:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010099309999999999, 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 242674 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639757+0000", 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639757+0000", 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639758+0000", 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5799999999999998e-07 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639761+0000", 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4809999999999998e-06 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639770+0000", 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0489999999999993e-06 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639776+0000", 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8540000000000002e-06 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.640375+0000", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059925500000000004 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.640475+0000", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9806e-05 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.640585+0000", 2024-09-12T21:52:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011003 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:242672 5.7 e60/21 5:ef242953:::benchmark_data_smithi053_32461_object93356:head v 60'15154, mlcod=60'15152)", 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:31.639796+0000", 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00046733099999999997, 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010332729999999999, 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639796+0000", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639796+0000", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639796+0000", 2024-09-12T21:52:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9099999999999999e-07 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639799+0000", 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4249999999999998e-06 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639806+0000", 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6839999999999999e-06 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639811+0000", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5390000000000001e-06 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639881+0000", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0599000000000006e-05 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:31.639900+0000", 2024-09-12T21:52:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8600000000000001e-05 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-09-12T21:52:31.685 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:31.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:31.687 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:31.685+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:31.786 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:31.785+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:31.881 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:31.882 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:31.887 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.885+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:31.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:31.988 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:31.986+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:32.089 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:32.087+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.752965449000001, 2024-09-12T21:52:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.751643923000003, 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.751156080000001, 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.750428698999997, 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.783584648000001, 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.783457189000003, 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.783398568999999, 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.781286922999996, 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.779629980999999, 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.778680382000005, 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.774456294999993, 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.772102756999999, 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.770479565000002, 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.411133544999998, 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.409416755999999, 2024-09-12T21:52:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.408677949000001, 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.408642239999999, 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.404344133999999, 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.400464409000001, 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.398213986000002, 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:32.218 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:32.220 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:32.218+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:32.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:32.321 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:32.320+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244958 5.6 5:63e430c9:::benchmark_data_smithi053_32461_object95642:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.367115+0000", 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001834036, 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0018550750000000001, 2024-09-12T21:52:32.370 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244958 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367115+0000", 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367115+0000", 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367116+0000", 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.372 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367120+0000", 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6100000000000002e-06 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367128+0000", 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9610000000000005e-06 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367133+0000", 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5130000000000004e-06 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.373 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367185+0000", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1585000000000002e-05 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367318+0000", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013299000000000001 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367441+0000", 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000123254 2024-09-12T21:52:32.374 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244959 5.1 5:8ac10100:::benchmark_data_smithi053_32461_object95643:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.367192+0000", 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001757254, 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001853022, 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:32.375 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244959 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367192+0000", 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367192+0000", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367193+0000", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3200000000000005e-07 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367196+0000", 2024-09-12T21:52:32.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1360000000000001e-06 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367204+0000", 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4910000000000005e-06 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367210+0000", 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5629999999999999e-06 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367251+0000", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1424000000000002e-05 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367370+0000", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000118867 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367478+0000", 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000107402 2024-09-12T21:52:32.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:244957 5.2 e60/36 5:44ed3b54:::benchmark_data_smithi053_32461_object95641:head v 60'15032, mlcod=60'15030)", 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.367471+0000", 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0014780679999999999, 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001640702, 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367471+0000", 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367471+0000", 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367472+0000", 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7800000000000002e-07 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367476+0000", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.476e-06 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367492+0000", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5464999999999998e-05 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367497+0000", 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5350000000000004e-06 2024-09-12T21:52:32.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367564+0000", 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6929999999999998e-05 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.367590+0000", 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.5993999999999999e-05 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244960 5.6 5.1f76b3a6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.368819+0000", 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00013047800000000001, 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00034456999999999999, 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244960 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368819+0000", 2024-09-12T21:52:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368819+0000", 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368820+0000", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7499999999999999e-07 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368825+0000", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7999999999999998e-06 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368842+0000", 2024-09-12T21:52:32.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6983999999999999e-05 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368850+0000", 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.028e-06 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244964 5.a 5:55ead243:::benchmark_data_smithi053_32461_object95648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.368955+0000", 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999948, 2024-09-12T21:52:32.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00026210699999999998, 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244964 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368955+0000", 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368955+0000", 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368955+0000", 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8100000000000002e-07 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368959+0000", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8039999999999999e-06 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368967+0000", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2959999999999999e-06 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.368974+0000", 2024-09-12T21:52:32.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7000000000000002e-06 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369029+0000", 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4959e-05 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369148+0000", 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011930399999999999 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244966 5.a 5.620b412a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.369114+0000", 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998355, 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000166711, 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244966 2024-09-12T21:52:32.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369114+0000", 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369114+0000", 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369115+0000", 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8899999999999999e-07 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369118+0000", 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1860000000000001e-06 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369127+0000", 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1500000000000005e-06 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369133+0000", 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6969999999999998e-06 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244967 5.9 5:9ce9c5bf:::benchmark_data_smithi053_32461_object95651:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.369143+0000", 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998069, 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019057500000000001, 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244967 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369143+0000", 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369143+0000", 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369143+0000", 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1699999999999999e-07 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369145+0000", 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.475e-06 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369152+0000", 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1260000000000003e-06 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369157+0000", 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1270000000000002e-06 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369202+0000", 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5299000000000001e-05 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369303+0000", 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101143 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:244968 5.6 5.68a106a6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:32.369167+0000", 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9997821, 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00020274400000000001, 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:32.403 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 244968 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369167+0000", 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369167+0000", 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369168+0000", 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7199999999999999e-07 2024-09-12T21:52:32.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369170+0000", 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3870000000000002e-06 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369177+0000", 2024-09-12T21:52:32.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4629999999999998e-06 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:32.369182+0000", 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1399999999999999e-06 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 8 2024-09-12T21:52:32.407 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:32.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:32.421 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:32.420+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:32.522 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:32.521+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:32.555 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:32.555 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:32.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:32.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:32.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:52:32.623 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:32.621+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:32.700 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:32.716 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:32.717 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:32.721 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:32.723 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:32.723+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:32.725 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:32.725 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:32.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:32.824 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:32.824+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:32.886 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:32.886 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:32.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:32.925 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:32.925+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.026 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.026+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.057 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.057 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:33.127 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:33.126+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:33.222 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.223 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.228 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.227+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:33.329 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.328+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.383 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.383 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:33.437 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.436+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.530 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.530+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.571 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:52:33.579 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.579 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:33.631 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:33.630+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:33.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.732+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.780 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.780 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:33.837 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:33.836+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:33.934 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:33.934+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:33.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:34.046 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:34.044+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:34.136 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:34.135+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:34.155 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:34.155 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:34.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:34.251 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:34.250+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:34.338 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:34.337+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:34.362 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:34.363 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:34.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:34.438 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:34.438+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:34.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-09-12T21:52:34.526 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:34.526 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:34.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:34.541 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:34.539+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:34.640 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:34.639+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:34.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:34.727 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:34.727 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:34.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:34.741 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:34.740+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:34.842 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:34.841+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:34.853 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:34.854 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:34.873 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:34.873 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:34.873 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:34.876 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:34.877 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:34.891 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:34.891 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.578894861999999, 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.892 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.893 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.894 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:34.895 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.896 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.897 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.577273466999998, 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.898 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.899 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.901 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.902 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.577183438000006, 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.905 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.906 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:34.907 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:34.908 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:34.909 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.574011737000006, 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.910 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.912 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.913 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:34.914 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.573491481999994, 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.916 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.917 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.918 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:34.919 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.920 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.921 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.566907995999998, 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.922 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:34.923 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:34.924 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:34.925 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:34.926 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 73.554298184000004, 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.928 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:34.929 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:34.930 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:34.931 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.932 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.933 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.381052036, 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.934 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.937 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.938 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.939 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.378501273000001, 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.940 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.941 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:34.942 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.943 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.944 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:34.945 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.946 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.375925586000001, 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.947 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:34.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.373738364000001, 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.954 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:34.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:34.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:34.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.960 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.368649736999998, 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:34.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.357476451, 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.967 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:34.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:34.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:34.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.353683173, 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:34.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:34.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.345889125999999, 2024-09-12T21:52:34.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.314262371000002, 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.295402863, 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:34.993 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:34.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:34.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:34.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:34.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:34.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.290608838000001, 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:34.999 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:35.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.005 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.289304692999998, 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:35.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:35.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.011 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 29.279351957999999, 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:35.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.019 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:35.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:35.021 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.019+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.121 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.120+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253612 5.b 5:dbd29a45:::benchmark_data_smithi053_32461_object104296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.174486+0000", 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020264060000000001, 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020466740000000001, 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253612 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174486+0000", 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174486+0000", 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174487+0000", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.47e-07 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174491+0000", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174502+0000", 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.081e-05 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174510+0000", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5539999999999998e-06 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174556+0000", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5682000000000001e-05 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174685+0000", 2024-09-12T21:52:35.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129493 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:253613 5.6 e61/36 5:6dfd15cb:::benchmark_data_smithi053_32461_object104297:head v 61'15934, mlcod=61'15932)", 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.174926+0000", 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001586386, 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016577740000000001, 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174926+0000", 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174926+0000", 2024-09-12T21:52:35.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174927+0000", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8299999999999997e-07 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174931+0000", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2259999999999999e-06 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174942+0000", 2024-09-12T21:52:35.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1171e-05 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174948+0000", 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2720000000000003e-06 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174999+0000", 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1167e-05 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175018+0000", 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8553e-05 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253614 5.c 5:35e4a705:::benchmark_data_smithi053_32461_object104298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.175647+0000", 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00086501999999999998, 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096904000000000001, 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253614 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175647+0000", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175647+0000", 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175648+0000", 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1999999999999998e-07 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175653+0000", 2024-09-12T21:52:35.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5879999999999999e-06 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175664+0000", 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1270000000000001e-05 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175672+0000", 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175764+0000", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2435000000000005e-05 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175892+0000", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012803700000000001 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.176001+0000", 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109226 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.190 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253615 5.e 5:76cad22b:::benchmark_data_smithi053_32461_object104299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.175697+0000", 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00081512399999999997, 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095886099999999998, 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253615 2024-09-12T21:52:35.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175697+0000", 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175697+0000", 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175698+0000", 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-07 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175701+0000", 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175708+0000", 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7270000000000007e-06 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175714+0000", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9800000000000003e-06 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175811+0000", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6531000000000001e-05 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175922+0000", 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011084199999999999 2024-09-12T21:52:35.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253592 5.0 5:01a02a56:::benchmark_data_smithi053_32461_object104276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.168204+0000", 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083086199999999992, 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084879259999999998, 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253592 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168204+0000", 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168204+0000", 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168204+0000", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9699999999999995e-07 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168208+0000", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9600000000000002e-06 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168217+0000", 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-06 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.168224+0000", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0700000000000001e-06 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.169771+0000", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001546637 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.169880+0000", 2024-09-12T21:52:35.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109143 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253596 5.8 5:16e0a3b5:::benchmark_data_smithi053_32461_object104280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.170630+0000", 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058822249999999996, 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060952990000000002, 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253596 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170630+0000", 2024-09-12T21:52:35.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170630+0000", 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170631+0000", 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2699999999999998e-07 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170635+0000", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1030000000000004e-06 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170651+0000", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076999999999999e-05 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170658+0000", 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-12T21:52:35.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171560+0000", 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090198899999999996 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171678+0000", 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118408 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253597 5.8 5:1aceb139:::benchmark_data_smithi053_32461_object104281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.170670+0000", 2024-09-12T21:52:35.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058424219999999999, 2024-09-12T21:52:35.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060982639999999999, 2024-09-12T21:52:35.205 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253597 2024-09-12T21:52:35.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170670+0000", 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170670+0000", 2024-09-12T21:52:35.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170670+0000", 2024-09-12T21:52:35.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6700000000000003e-07 2024-09-12T21:52:35.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170673+0000", 2024-09-12T21:52:35.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6410000000000002e-06 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170681+0000", 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7200000000000006e-06 2024-09-12T21:52:35.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.170686+0000", 2024-09-12T21:52:35.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9960000000000001e-06 2024-09-12T21:52:35.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173436+0000", 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002750602 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173557+0000", 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120221 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253603 5.8 5:1170c78f:::benchmark_data_smithi053_32461_object104287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.171802+0000", 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047103989999999997, 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050319420000000002, 2024-09-12T21:52:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253603 2024-09-12T21:52:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171802+0000", 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171802+0000", 2024-09-12T21:52:35.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171803+0000", 2024-09-12T21:52:35.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4199999999999995e-07 2024-09-12T21:52:35.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171806+0000", 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8659999999999999e-06 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171814+0000", 2024-09-12T21:52:35.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1300000000000003e-06 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.171818+0000", 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-12T21:52:35.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175198+0000", 2024-09-12T21:52:35.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033802820000000001 2024-09-12T21:52:35.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175299+0000", 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100899 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253605 5.5 5:aa244c39:::benchmark_data_smithi053_32461_object104289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.172050+0000", 2024-09-12T21:52:35.225 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044618710000000001, 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048377369999999999, 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253605 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172050+0000", 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172050+0000", 2024-09-12T21:52:35.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172051+0000", 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3499999999999996e-07 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172055+0000", 2024-09-12T21:52:35.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.749e-06 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172062+0000", 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9840000000000004e-06 2024-09-12T21:52:35.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172066+0000", 2024-09-12T21:52:35.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6399999999999996e-06 2024-09-12T21:52:35.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172114+0000", 2024-09-12T21:52:35.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.74e-05 2024-09-12T21:52:35.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172224+0000", 2024-09-12T21:52:35.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110061 2024-09-12T21:52:35.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.172329+0000", 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104838 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.175949+0000", 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036206789999999999 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253609 5.5 5:a5607341:::benchmark_data_smithi053_32461_object104293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.173451+0000", 2024-09-12T21:52:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030608139999999998, 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003511681, 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253609 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173451+0000", 2024-09-12T21:52:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173451+0000", 2024-09-12T21:52:35.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173452+0000", 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6200000000000006e-07 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173457+0000", 2024-09-12T21:52:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9010000000000002e-06 2024-09-12T21:52:35.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173470+0000", 2024-09-12T21:52:35.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2335e-05 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173478+0000", 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4619999999999996e-06 2024-09-12T21:52:35.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174159+0000", 2024-09-12T21:52:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068061100000000002 2024-09-12T21:52:35.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174299+0000", 2024-09-12T21:52:35.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140459 2024-09-12T21:52:35.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.174421+0000", 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012142 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.176817+0000", 2024-09-12T21:52:35.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023966069999999998 2024-09-12T21:52:35.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:253610 5.e 5:7f7ce6e0:::benchmark_data_smithi053_32461_object104294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:35.173493+0000", 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003019309, 2024-09-12T21:52:35.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003511845, 2024-09-12T21:52:35.250 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:35.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 253610 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173493+0000", 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173493+0000", 2024-09-12T21:52:35.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173493+0000", 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0100000000000005e-07 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173496+0000", 2024-09-12T21:52:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3209999999999999e-06 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173503+0000", 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.413e-06 2024-09-12T21:52:35.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173509+0000", 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5600000000000001e-06 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173559+0000", 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0265000000000001e-05 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:35.173693+0000", 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133471 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.259 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:35.259 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-09-12T21:52:35.259 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:35.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:35.261 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:35.259+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:35.361 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.360+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.460 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:35.460 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:35.460 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:35.460 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:35.460 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:35.463 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.460+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.470 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:35.562 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.561+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.585 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:52:35.662 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.661+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:35.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.327490193000003, 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:35.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:35.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.326168667000005, 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:35.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.325680824000003, 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:35.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:35.689 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.324953442999998, 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:35.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:35.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:35.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.358109392000003, 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:35.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.357981933000005, 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.357923313000001, 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:35.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:35.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:35.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.355811666999998, 2024-09-12T21:52:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:35.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:35.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:35.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.354154725000001, 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:35.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:35.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.353205126000006, 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.726 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:35.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:35.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.732 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.348981038999995, 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.733 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:35.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.346627501, 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:35.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:35.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:35.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.345004309000004, 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:35.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:35.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:35.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:35.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.985658289, 2024-09-12T21:52:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:35.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:35.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:35.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.9839415, 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:35.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:35.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:35.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:35.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.983202692999999, 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:35.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:35.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.983166984, 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:35.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:35.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.978868878, 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:35.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:35.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.974989152999999, 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:35.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:35.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:35.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.97273873, 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:35.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:35.798 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:35.800 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:35.799+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:35.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:35.901 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:35.900+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256015 5.9 5:965ff648:::benchmark_data_smithi053_32461_object106699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.943486+0000", 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0024080360000000001, 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0024317499999999999, 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.948 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256015 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943486+0000", 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943486+0000", 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943487+0000", 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.950 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943490+0000", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8710000000000001e-06 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943501+0000", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0922e-05 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943506+0000", 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.237e-06 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944880+0000", 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0013740810000000001 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945032+0000", 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015207799999999999 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:256003 5.1 e61/36)", 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.944928+0000", 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000966478, 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001052868, 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944928+0000", 2024-09-12T21:52:35.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944928+0000", 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944928+0000", 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944933+0000", 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-06 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944948+0000", 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5167999999999999e-05 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944954+0000", 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2330000000000003e-06 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.955 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:256010 5.1 e61/36)", 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.945317+0000", 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00057721599999999997, 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00070312599999999999, 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945317+0000", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945317+0000", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945318+0000", 2024-09-12T21:52:35.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0699999999999997e-07 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945322+0000", 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0609999999999997e-06 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945330+0000", 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1100000000000003e-06 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945336+0000", 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6890000000000001e-06 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256019 5.d 5:be2f02da:::benchmark_data_smithi053_32461_object106703:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.945656+0000", 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000238013, 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00040779800000000001, 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.959 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256019 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945656+0000", 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945656+0000", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945657+0000", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4900000000000005e-07 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945661+0000", 2024-09-12T21:52:35.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.738e-06 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945670+0000", 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9600000000000006e-06 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945675+0000", 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7899999999999999e-06 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945720+0000", 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5871000000000002e-05 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945841+0000", 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012045900000000001 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:255990 5.6 5:6b1d6a2c:::benchmark_data_smithi053_32461_object106674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.963 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.935956+0000", 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0099384759999999999, 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010167743, 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 255990 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935956+0000", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935956+0000", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935956+0000", 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4000000000000002e-07 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935959+0000", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.621e-06 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935967+0000", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9119999999999998e-06 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.935972+0000", 2024-09-12T21:52:35.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2700000000000004e-06 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939055+0000", 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0030827630000000001 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939168+0000", 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011326400000000001 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939323+0000", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00015521099999999999 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942592+0000", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032686569999999999 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946055+0000", 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034627199999999999 2024-09-12T21:52:35.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946085+0000", 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0762999999999997e-05 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256020 5.f 5:fc67eedf:::benchmark_data_smithi053_32461_object106704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.945927+0000", 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999676, 2024-09-12T21:52:35.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00028162, 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256020 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945927+0000", 2024-09-12T21:52:35.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945927+0000", 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945927+0000", 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9699999999999995e-07 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945931+0000", 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.54e-06 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945945+0000", 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4272e-05 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945953+0000", 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3080000000000008e-06 2024-09-12T21:52:35.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.945996+0000", 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3040000000000001e-05 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946114+0000", 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011801199999999999 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:256018 5.3 e61/21 5:c788d4e0:::benchmark_data_smithi053_32461_object106702:head v 61'16305, mlcod=61'16302)", 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.946073+0000", 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998212, 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00019470300000000001, 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946073+0000", 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946073+0000", 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946074+0000", 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9200000000000001e-07 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946079+0000", 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.152e-06 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946087+0000", 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0770000000000008e-06 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946092+0000", 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3870000000000003e-06 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946134+0000", 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1474000000000003e-05 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946151+0000", 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7271000000000001e-05 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:255996 5.6 e61/36)", 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.946204+0000", 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9996896, 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0001117, 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946204+0000", 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946204+0000", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946205+0000", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9299999999999998e-07 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946209+0000", 2024-09-12T21:52:35.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7220000000000001e-06 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946215+0000", 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.229e-06 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946219+0000", 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0690000000000003e-06 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.980 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:255995 5.6 5:664d4568:::benchmark_data_smithi053_32461_object106679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.937099+0000", 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0087955740000000004, 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0092623659999999993, 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.981 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 255995 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937099+0000", 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937099+0000", 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937099+0000", 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5799999999999998e-07 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937103+0000", 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6109999999999998e-06 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937111+0000", 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4490000000000002e-06 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937117+0000", 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3409999999999999e-06 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941000+0000", 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038831619999999999 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941121+0000", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120918 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941231+0000", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010966 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946271+0000", 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050403599999999998 2024-09-12T21:52:35.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946304+0000", 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3467000000000003e-05 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946333+0000", 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8830999999999999e-05 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:255996 5.6 5:6678232c:::benchmark_data_smithi053_32461_object106680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.937264+0000", 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0086298810000000007, 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0091807639999999992, 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 255996 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.987 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937264+0000", 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937264+0000", 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937265+0000", 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4099999999999998e-07 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937268+0000", 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3799999999999998e-06 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937275+0000", 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.046e-06 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.937281+0000", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3750000000000002e-06 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942654+0000", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0053733979999999997 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942784+0000", 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012974199999999999 2024-09-12T21:52:35.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942897+0000", 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000113084 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946277+0000", 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.003379632 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:255998 5.9 5:9dcffedd:::benchmark_data_smithi053_32461_object106682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.938255+0000", 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0076391039999999999, 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0082598700000000008, 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 255998 2024-09-12T21:52:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938255+0000", 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938255+0000", 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938256+0000", 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5300000000000004e-07 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938259+0000", 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4460000000000001e-06 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938269+0000", 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0020000000000001e-05 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938276+0000", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5549999999999999e-06 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940960+0000", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026838980000000001 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941082+0000", 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012222000000000001 2024-09-12T21:52:35.995 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:255999 5.6 5:6e9b6f72:::benchmark_data_smithi053_32461_object106683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.938546+0000", 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0073478770000000001, 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0080260120000000008, 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:35.996 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 255999 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938546+0000", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938546+0000", 2024-09-12T21:52:35.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938547+0000", 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4000000000000001e-07 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938551+0000", 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.54e-06 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938560+0000", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.6099999999999995e-06 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.938567+0000", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469999999999999e-06 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944218+0000", 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0056509910000000002 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:35.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944341+0000", 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012246199999999999 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944463+0000", 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012256600000000001 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.000 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256003 5.1 5:85212b75:::benchmark_data_smithi053_32461_object106687:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.939997+0000", 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0058968620000000001, 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0066435440000000004, 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256003 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.001 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939997+0000", 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939997+0000", 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.939998+0000", 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.33e-07 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940003+0000", 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6879999999999998e-06 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940014+0000", 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1113e-05 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940021+0000", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9970000000000001e-06 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940941+0000", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00091975300000000004 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941041+0000", 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9877999999999995e-05 2024-09-12T21:52:36.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941114+0000", 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3178999999999998e-05 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.944859+0000", 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037452929999999998 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256007 5.6 5:6bcd4369:::benchmark_data_smithi053_32461_object106691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.940837+0000", 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0050575769999999997, 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0058714120000000003, 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256007 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.006 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940837+0000", 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940837+0000", 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940837+0000", 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6000000000000003e-07 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940841+0000", 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9700000000000001e-06 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940851+0000", 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.9170000000000001e-06 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.940858+0000", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9430000000000003e-06 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946619+0000", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057608800000000003 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.946689+0000", 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0049999999999995e-05 2024-09-12T21:52:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256010 5.1 5:8f3ed6a3:::benchmark_data_smithi053_32461_object106694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.941023+0000", 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.004871663, 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0057623090000000002, 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.010 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256010 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941023+0000", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941023+0000", 2024-09-12T21:52:36.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941023+0000", 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.54e-07 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941027+0000", 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1949999999999999e-06 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941034+0000", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3599999999999998e-06 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.941040+0000", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0739999999999998e-06 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942817+0000", 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001777236 2024-09-12T21:52:36.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.942940+0000", 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012242899999999999 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943055+0000", 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000115381 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:256012 5.6 5.e4e912a6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:35.943357+0000", 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0025370900000000001, 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034914329999999999, 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 256012 2024-09-12T21:52:36.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943357+0000", 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943357+0000", 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943358+0000", 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.13e-07 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943361+0000", 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4539999999999999e-06 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943370+0000", 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1670000000000005e-06 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:35.943376+0000", 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3399999999999997e-06 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 16 2024-09-12T21:52:36.018 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:36.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:36.020 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:36.019+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:36.121 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:36.119+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:36.210 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:36.210 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:36.210 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:36.211 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:36.211 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:36.222 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:36.221+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:36.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:36.322 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:36.322+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:36.375 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:36.375 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.062137445999994, 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.376 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.377 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:36.378 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.379 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.382 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.060516050999993, 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.383 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.385 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.387 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:36.388 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.060426022000001, 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.389 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:36.391 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.392 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.393 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:36.394 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.057254321000002, 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:36.395 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:36.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:36.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:36.400 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.056734066000004, 2024-09-12T21:52:36.401 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.402 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.405 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.406 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.408 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.050150579999993, 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:36.416 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 75.037540768, 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.417 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.418 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:36.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.420 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.421 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.422 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.864294619999999, 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:36.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:36.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:36.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.861743857, 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:36.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.85916817, 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:36.438 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:36.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:36.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:36.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.856980948, 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.445 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:36.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:36.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:36.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:36.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.851892321000001, 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:36.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.458 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.840719034999999, 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:36.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:36.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:36.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:36.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.464 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.836925756999999, 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:36.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.467 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.829131709999999, 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:36.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.475 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.477 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.797504955000001, 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.478 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:36.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:36.484 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.778645446999999, 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:36.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:36.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.773851422, 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:36.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:36.498 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.772547277000001, 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.499 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:36.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:36.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.504 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 30.762594541999999, 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:36.506 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:36.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:36.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:36.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:36.513 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:36.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:36.515 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:36.513+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:52:36.616 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:36.614+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:36.672 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:36.672 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:36.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258278 5.8 5:1836ea45:::benchmark_data_smithi053_32461_object108962:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.670190+0000", 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00043456199999999999, 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045796699999999999, 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258278 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670190+0000", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670190+0000", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670191+0000", 2024-09-12T21:52:36.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670195+0000", 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670204+0000", 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5900000000000008e-06 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670210+0000", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4359999999999999e-06 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670278+0000", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7729000000000002e-05 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670401+0000", 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012314800000000001 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258280 5.3 5.69432dc3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.670225+0000", 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00040017200000000002, 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000490049, 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:36.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258280 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670225+0000", 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670225+0000", 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670225+0000", 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1500000000000005e-07 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670228+0000", 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3649999999999998e-06 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670235+0000", 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9210000000000003e-06 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670240+0000", 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1379999999999998e-06 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258282 5.8 5.92840bd8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.670623+0000", 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1900000000000002e-06, 2024-09-12T21:52:36.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141698, 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258282 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670623+0000", 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670623+0000", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670624+0000", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2500000000000004e-07 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670628+0000", 2024-09-12T21:52:36.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9770000000000002e-06 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670637+0000", 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0559999999999994e-06 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670643+0000", 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3600000000000001e-06 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:258279 5.6 e62/36 5:64a55d21:::benchmark_data_smithi053_32461_object108963:head v 62'16241, mlcod=62'16239)", 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.670664+0000", 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999609, 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015398000000000001, 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670664+0000", 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670664+0000", 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670664+0000", 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000001e-07 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670672+0000", 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909999999999997e-06 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670679+0000", 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.426e-06 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670688+0000", 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9380000000000004e-06 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670729+0000", 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0402999999999999e-05 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670751+0000", 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1749000000000001e-05 2024-09-12T21:52:36.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:258262 5.2 e62/36)", 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.670703+0000", 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999223, 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017353, 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670703+0000", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670703+0000", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670703+0000", 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1e-07 2024-09-12T21:52:36.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670705+0000", 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0609999999999998e-06 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670711+0000", 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140000000000004e-06 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670715+0000", 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0729999999999998e-06 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670868+0000", 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152929 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670875+0000", 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5350000000000001e-06 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258262 5.2 5:4f327c12:::benchmark_data_smithi053_32461_object108946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.664782+0000", 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005842931, 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061540589999999999, 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258262 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664782+0000", 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664782+0000", 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664783+0000", 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6700000000000003e-07 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664786+0000", 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664794+0000", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3140000000000004e-06 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.664800+0000", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9000000000000003e-06 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667436+0000", 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026362960000000002 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667548+0000", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111068 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667652+0000", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010495 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670880+0000", 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032273179999999999 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258265 5.0 5:0fbcca47:::benchmark_data_smithi053_32461_object108949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.665868+0000", 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047571250000000001, 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051402899999999996, 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258265 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665868+0000", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665868+0000", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665869+0000", 2024-09-12T21:52:36.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0500000000000003e-07 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665872+0000", 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1729999999999999e-06 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665882+0000", 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0311e-05 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665888+0000", 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.665954+0000", 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6301000000000001e-05 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.666086+0000", 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013236500000000001 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258268 5.8 5:12b62a9f:::benchmark_data_smithi053_32461_object108952:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.667445+0000", 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031798479999999999, 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036226370000000002, 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258268 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667445+0000", 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667445+0000", 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667446+0000", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667450+0000", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0269999999999997e-06 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667459+0000", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0440000000000001e-06 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667466+0000", 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.55e-06 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667551+0000", 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5693999999999996e-05 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.667673+0000", 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012121999999999999 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258269 5.b 5:d346813d:::benchmark_data_smithi053_32461_object108953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.668612+0000", 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020128329999999999, 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025161720000000001, 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258269 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668612+0000", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668612+0000", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668613+0000", 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5600000000000004e-07 2024-09-12T21:52:36.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668617+0000", 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3730000000000001e-06 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668629+0000", 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2867999999999999e-05 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668637+0000", 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3289999999999996e-06 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668795+0000", 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158214 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668902+0000", 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010742399999999999 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258271 5.3 5:cc1e69f3:::benchmark_data_smithi053_32461_object108955:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.668652+0000", 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019726750000000001, 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025351449999999999, 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258271 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.710 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668652+0000", 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668652+0000", 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668653+0000", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668655+0000", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668662+0000", 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7290000000000003e-06 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.668668+0000", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6489999999999996e-06 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670517+0000", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001849519 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670624+0000", 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106662 2024-09-12T21:52:36.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.670720+0000", 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6546999999999996e-05 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258274 5.4 5:27059c25:::benchmark_data_smithi053_32461_object108958:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.669347+0000", 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00127798, 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00190756, 2024-09-12T21:52:36.714 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258274 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669347+0000", 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669347+0000", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669348+0000", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5799999999999998e-07 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669352+0000", 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9439999999999998e-06 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669363+0000", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1287999999999999e-05 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669370+0000", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4409999999999998e-06 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669435+0000", 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4817e-05 2024-09-12T21:52:36.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669565+0000", 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130166 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258275 5.c 5:3fb2dd55:::benchmark_data_smithi053_32461_object108959:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.669386+0000", 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001239434, 2024-09-12T21:52:36.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001926741, 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258275 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669386+0000", 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669386+0000", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669386+0000", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1600000000000002e-07 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669389+0000", 2024-09-12T21:52:36.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5000000000000002e-06 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669408+0000", 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9724999999999998e-05 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669414+0000", 2024-09-12T21:52:36.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4190000000000001e-06 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669452+0000", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669570+0000", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118831 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669672+0000", 2024-09-12T21:52:36.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101098 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258276 5.4 5.8e81fdb4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.669420+0000", 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012049020000000001, 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019532289999999999, 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:36.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258276 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669420+0000", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669420+0000", 2024-09-12T21:52:36.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669421+0000", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2800000000000002e-07 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669423+0000", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.193e-06 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669428+0000", 2024-09-12T21:52:36.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669433+0000", 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3359999999999997e-06 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:258277 5.3 5.73efccc3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:36.669443+0000", 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011824089999999999, 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001978002, 2024-09-12T21:52:36.726 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 258277 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669443+0000", 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669443+0000", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669443+0000", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2000000000000001e-07 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669445+0000", 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9089999999999998e-06 2024-09-12T21:52:36.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669451+0000", 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7950000000000004e-06 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:36.669455+0000", 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3479999999999997e-06 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:36.729 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:36.730 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-09-12T21:52:36.730 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:36.731 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:36.730+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:36.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:36.832 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:36.831+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:36.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:36.924 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:36.925 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:36.933 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:36.932+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:36.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:37.006 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:37.006 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:37.025 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:37.029 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:37.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:37.034 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:37.033+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:37.095 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.095 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:37.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:37.151 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:37.150+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:37.236 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:37.235+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:37.254 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.254 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:37.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:37.350 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:37.349+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:37.438 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:37.436+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:37.451 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.451 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:37.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:37.538 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:37.537+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:37.639 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:37.638+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:37.649 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.650 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:37.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:37.740 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:37.740+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:37.817 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.817 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:37.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:37.841 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:37.841+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:37.942 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:37.941+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:37.991 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:37.991 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:38.046 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.045+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.145 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.143+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.203 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:38.203 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:38.258 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:38.258+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:38.345 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.344+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.362 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:38.362 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:38.446 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.445+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.547 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.546+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.563 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:38.564 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:38.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:38.647 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:38.647+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:38.725 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:38.725 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:38.783 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.782+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.848 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.847+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:38.892 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:38.892 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:38.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:38.950 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:38.949+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:39.050 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:39.049+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.102 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:39.102 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:39.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:39.151 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:39.150+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:39.161 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:39.162 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:39.182 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:39.182 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:39.182 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:39.185 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:39.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:39.252 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:39.251+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.964967435000005, 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:39.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:39.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.963645908999993, 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:39.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:39.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:39.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.963158066000005, 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:39.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:39.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:39.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.962430685000001, 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:39.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:39.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.995586634000006, 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:39.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:39.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.995459174999993, 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:39.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:39.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.995400555000003, 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:39.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.993288909, 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.991631967000004, 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.990682367999995, 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:39.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.986458280999997, 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:39.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:39.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.984104743000003, 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:39.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:39.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.982481551000006, 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:39.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.623135530999999, 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:39.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:39.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.621418741999999, 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:39.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:39.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:39.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:39.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.620679934999998, 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:39.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.620644226, 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:39.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.616346119999999, 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:39.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:39.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.612466394999998, 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:39.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:39.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:39.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.610215971999999, 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:39.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:39.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:39.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:39.432 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:39.433 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:39.432+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:39.534 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:39.533+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:267133 5.6 5:6373f552:::benchmark_data_smithi053_32461_object117817:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:39.580906+0000", 2024-09-12T21:52:39.583 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001869199, 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001886651, 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 267133 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.584 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580906+0000", 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580906+0000", 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580907+0000", 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.017e-06 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.585 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580911+0000", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0300000000000004e-06 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580920+0000", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8519999999999993e-06 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.580928+0000", 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5889999999999997e-06 2024-09-12T21:52:39.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581003+0000", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5199999999999998e-05 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581129+0000", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000126074 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581269+0000", 2024-09-12T21:52:39.587 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013976700000000001 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:267134 5.7 5:eea50b79:::benchmark_data_smithi053_32461_object117818:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:39.581689+0000", 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001086084, 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0011529260000000001, 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:39.588 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 267134 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581689+0000", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581689+0000", 2024-09-12T21:52:39.589 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581690+0000", 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.68e-07 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581693+0000", 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2899999999999998e-06 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.590 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581702+0000", 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4589999999999998e-06 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581707+0000", 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8400000000000002e-06 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581749+0000", 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2178000000000002e-05 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.591 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581878+0000", 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012913700000000001 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:39.581988+0000", 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000109651 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:39.592 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 2 2024-09-12T21:52:39.593 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:39.593 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:39.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:39.637 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:39.636+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:39.737 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:39.735+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.786 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:39.786 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:39.786 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:39.786 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:39.786 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:39.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:39.838 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:39.837+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.938 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:39.937+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:39.952 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:39.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.638961108999993, 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:39.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.956 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.637339714000007, 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.960 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:39.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:39.965 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.637249685, 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.966 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:39.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:39.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.634077984000001, 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:39.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:39.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.633557729000003, 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:39.978 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:39.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.626974243000006, 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.985 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:39.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:39.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.990 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 78.614364430999998, 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:39.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:39.996 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.441118283000002, 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:39.997 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:39.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:39.999 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:40.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.003 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.438567519999999, 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.004 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.006 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:40.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.435991833000003, 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.011 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:40.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:40.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:40.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:40.024 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.433804610999999, 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.027 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:40.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:40.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.032 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.032 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:40.032 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.428715984, 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.034 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:40.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:40.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.417542697999998, 2024-09-12T21:52:40.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.040 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:40.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:40.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:40.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:40.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.413749420000002, 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:40.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:40.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:40.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.405955372999998, 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:40.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:40.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:40.060 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.374328618, 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.061 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:40.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:40.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:40.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:40.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:40.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:40.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:40.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:40.071 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.072 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.072 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.072 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.355469110000001, 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.073 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.074 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:40.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:40.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:40.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:40.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:40.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:40.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:40.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:40.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:40.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:40.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:40.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:40.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.087 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.350675084999999, 2024-09-12T21:52:40.089 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:40.090 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.090 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.090 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.090 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.091 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.092 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:40.092 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.092 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.092 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.099 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.100 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.100 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:40.100 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:40.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.100 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.101 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.102 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:40.102 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:40.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.102 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.102 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.103 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:40.104 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:40.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.104 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.104 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.104 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.105 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.34937094, 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.106 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.107 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.107 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.107 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:40.108 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.109 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.109 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:40.109 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:40.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.111 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.111 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.111 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:40.111 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:40.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.112 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.113 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.113 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:40.113 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:40.113 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.113 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.114 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.115 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:40.115 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:40.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.115 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.115 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.116 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:40.117 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:40.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.117 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.117 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.117 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:40.118 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:40.118 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.118 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.118 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.118 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:40.119 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:40.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.120 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.120 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.120 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:40.120 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:40.121 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:40.122 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:40.123 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 34.339418205000001, 2024-09-12T21:52:40.123 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:40.123 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:40.123 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:40.123 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.124 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.125 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.126 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:40.126 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:40.126 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:40.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.126 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.127 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:40.128 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:40.128 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:40.128 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.128 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.128 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.129 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:40.130 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:40.131 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.131 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.131 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.131 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:40.131 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.133 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.133 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:40.133 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:40.134 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:40.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:40.137 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.138 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:40.139 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:40.139 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:40.142 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:40.139+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:40.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:40.242 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:40.241+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:40.299 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269353 5.0 5:00172765:::benchmark_data_smithi053_32461_object120037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.294051+0000", 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036685469999999999, 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036910770000000001, 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269353 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294051+0000", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294051+0000", 2024-09-12T21:52:40.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294052+0000", 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0449999999999999e-06 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294056+0000", 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0269999999999997e-06 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294064+0000", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3559999999999993e-06 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294070+0000", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0789999999999997e-06 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295018+0000", 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094708200000000002 2024-09-12T21:52:40.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295935+0000", 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091747200000000001 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269354 5.8 5.d26edf38 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.294330+0000", 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033895209999999999, 2024-09-12T21:52:40.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034767449999999998, 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269354 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294330+0000", 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294330+0000", 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294331+0000", 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3799999999999996e-07 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294335+0000", 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8519999999999997e-06 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294343+0000", 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6070000000000008e-06 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294349+0000", 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.066e-06 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269355 5.b 5:d695702d:::benchmark_data_smithi053_32461_object120039:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.294424+0000", 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032954389999999998, 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034406879999999999, 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269355 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294424+0000", 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294424+0000", 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294425+0000", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9999999999999998e-07 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294427+0000", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.604e-06 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294433+0000", 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7069999999999997e-06 2024-09-12T21:52:40.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294438+0000", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.463e-06 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294511+0000", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3059000000000006e-05 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294629+0000", 2024-09-12T21:52:40.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117102 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269356 5.3 5:c8bac3f8:::benchmark_data_smithi053_32461_object120040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.294595+0000", 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003124319, 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003329369, 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269356 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294595+0000", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294595+0000", 2024-09-12T21:52:40.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294596+0000", 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3600000000000003e-07 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294599+0000", 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.331e-06 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294606+0000", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2819999999999999e-06 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294610+0000", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0010000000000003e-06 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294642+0000", 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-12T21:52:40.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294713+0000", 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1526000000000006e-05 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294798+0000", 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4717999999999998e-05 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297349+0000", 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025513200000000002 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269358 5.b 5:dd94c873:::benchmark_data_smithi053_32461_object120042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.294911+0000", 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028087260000000001, 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030850299999999999, 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269358 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294911+0000", 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294911+0000", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294911+0000", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3600000000000003e-07 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294915+0000", 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7850000000000002e-06 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294924+0000", 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3080000000000008e-06 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.294929+0000", 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6579999999999999e-06 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296422+0000", 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014932840000000001 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296536+0000", 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113576 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269359 5.4 5:254dd5f1:::benchmark_data_smithi053_32461_object120043:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.295268+0000", 2024-09-12T21:52:40.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002451852, 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027997510000000001, 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269359 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295268+0000", 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295268+0000", 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295268+0000", 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3399999999999998e-07 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295272+0000", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8020000000000002e-06 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295281+0000", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.251e-06 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295287+0000", 2024-09-12T21:52:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.913e-06 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295359+0000", 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1703000000000001e-05 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295483+0000", 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123442 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269360 5.4 5:262d5d3c:::benchmark_data_smithi053_32461_object120044:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.296501+0000", 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00121882, 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001628142, 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269360 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296501+0000", 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296501+0000", 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296501+0000", 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8999999999999995e-07 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296505+0000", 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9199999999999997e-06 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296515+0000", 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9510000000000001e-06 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296522+0000", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.776e-06 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297400+0000", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087792000000000002 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297504+0000", 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104182 2024-09-12T21:52:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269361 5.5 5:a82b6fdf:::benchmark_data_smithi053_32461_object120045:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.296536+0000", 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00118312, 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016525450000000001, 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269361 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296536+0000", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296536+0000", 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296537+0000", 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.46e-07 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296539+0000", 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1619999999999998e-06 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296546+0000", 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9619999999999996e-06 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296551+0000", 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.668e-06 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296608+0000", 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6910000000000002e-05 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296713+0000", 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105579 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296810+0000", 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6803000000000001e-05 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269332 5.0 5:0fab49eb:::benchmark_data_smithi053_32461_object120016:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.286961+0000", 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010758435, 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011291710999999999, 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269332 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286961+0000", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286961+0000", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286962+0000", 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0070000000000001e-06 2024-09-12T21:52:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286970+0000", 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8429999999999993e-06 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286980+0000", 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0264e-05 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.286987+0000", 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6019999999999996e-06 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.290420+0000", 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034331359999999998 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.290537+0000", 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117519 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4635.0:269356 5.3 e63/21 ondisk, result = 0)", 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.297172+0000", 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00054758599999999997, 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011355639999999999, 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297172+0000", 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297172+0000", 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297173+0000", 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-07 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297176+0000", 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4479999999999999e-06 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297193+0000", 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6586e-05 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297199+0000", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1550000000000004e-06 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297337+0000", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013802500000000001 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297344+0000", 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2819999999999999e-06 2024-09-12T21:52:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269333 5.8 5:1a113af2:::benchmark_data_smithi053_32461_object120017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.287004+0000", 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010715499999999999, 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011357081999999999, 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269333 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287004+0000", 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287004+0000", 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287005+0000", 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4499999999999997e-07 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287007+0000", 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5450000000000002e-06 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287014+0000", 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2309999999999999e-06 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287019+0000", 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7990000000000001e-06 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.290318+0000", 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032986349999999998 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291020+0000", 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00070181200000000001 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269364 5.2 5:4aea0dc0:::benchmark_data_smithi053_32461_object120048:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.297737+0000", 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999828, 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068431099999999995, 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269364 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297737+0000", 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297737+0000", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297738+0000", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2139999999999999e-06 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297743+0000", 2024-09-12T21:52:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297754+0000", 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1785e-05 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297762+0000", 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1980000000000004e-06 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297816+0000", 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4539000000000001e-05 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.297948+0000", 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131645 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298065+0000", 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117428 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:269363 5.6 e63/36 5:6ff725ee:::benchmark_data_smithi053_32461_object120047:head v 63'16950, mlcod=63'16948)", 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.298040+0000", 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996796, 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044663, 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298040+0000", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298040+0000", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298041+0000", 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0200000000000001e-07 2024-09-12T21:52:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298046+0000", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5679999999999999e-06 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298055+0000", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7949999999999996e-06 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298061+0000", 2024-09-12T21:52:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0449999999999997e-06 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298117+0000", 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5760000000000001e-05 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.298137+0000", 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0020000000000001e-05 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269337 5.0 5:0462a7bf:::benchmark_data_smithi053_32461_object120021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.287357+0000", 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010362817999999999, 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011184515000000001, 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269337 2024-09-12T21:52:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287357+0000", 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287357+0000", 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287357+0000", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5300000000000003e-07 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287361+0000", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9820000000000002e-06 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287371+0000", 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7350000000000008e-06 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287378+0000", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8809999999999998e-06 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.292280+0000", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049015630000000003 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.292411+0000", 2024-09-12T21:52:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013095700000000001 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269341 5.8 5:1dcf672b:::benchmark_data_smithi053_32461_object120025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.287493+0000", 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010226760999999999, 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011111642, 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269341 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287493+0000", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287493+0000", 2024-09-12T21:52:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287494+0000", 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600000000000005e-07 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287498+0000", 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0770000000000001e-06 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287509+0000", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.097e-05 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.287515+0000", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7259999999999996e-06 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.293025+0000", 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055100269999999998 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.293143+0000", 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117773 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:269349 5.8 5:117ee4a5:::benchmark_data_smithi053_32461_object120033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:40.291808+0000", 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00591166, 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068555860000000003, 2024-09-12T21:52:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 269349 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291808+0000", 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291808+0000", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291809+0000", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.78e-07 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291813+0000", 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.42e-06 2024-09-12T21:52:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291823+0000", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8579999999999995e-06 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.291830+0000", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6619999999999999e-06 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.295915+0000", 2024-09-12T21:52:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004085305 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:40.296023+0000", 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107633 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-09-12T21:52:40.368 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:40.370 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:40.369+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:40.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:40.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-09-12T21:52:40.470 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:40.469+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:40.563 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:40.563 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:40.564 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:40.571 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:40.570+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:40.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:40.671 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:40.670+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.428847997999995, 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:40.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:40.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.427526471999997, 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.427038628999995, 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.426311248000005, 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.459467196999995, 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.459339737999997, 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.459281118000007, 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.457169472000004, 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.455512529999993, 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.454562930999998, 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.450338844000001, 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.447985306000007, 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.446362113999996, 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.087016093999999, 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.085299304999999, 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:40.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.084560497999998, 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:40.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:40.878 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.084524789, 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:40.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:40.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.080226682999999, 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:40.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.076346957999998, 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:40.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:40.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:40.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.074096534999999, 2024-09-12T21:52:40.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:40.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:40.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:40.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:40.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:40.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:40.904 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:40.905 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:40.904+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:40.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:41.006 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.005+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:41.050 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:41.050 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271700 5.a 5:50c75aea:::benchmark_data_smithi053_32461_object122384:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.048247+0000", 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00084330400000000002, 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00086019500000000001, 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271700 2024-09-12T21:52:41.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048247+0000", 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048247+0000", 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048248+0000", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9299999999999996e-07 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048253+0000", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5229999999999997e-06 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048262+0000", 2024-09-12T21:52:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2280000000000004e-06 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048268+0000", 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3210000000000001e-06 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048312+0000", 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3591000000000003e-05 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:41.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048438+0000", 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012675499999999999 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048555+0000", 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011654699999999999 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271701 5.a 5.b2ab82ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.055 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.048359+0000", 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00073137199999999999, 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00079149500000000002, 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271701 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048359+0000", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048359+0000", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048360+0000", 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.1800000000000005e-07 2024-09-12T21:52:41.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048366+0000", 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0209999999999996e-06 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048373+0000", 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6469999999999998e-06 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048379+0000", 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.4609999999999999e-06 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:271698 5.5 e63/21 5:aff8e383:::benchmark_data_smithi053_32461_object122382:head v 63'16918, mlcod=63'16913)", 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.048399+0000", 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00069177699999999997, 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00078238500000000002, 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.059 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048399+0000", 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048399+0000", 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.060 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048399+0000", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3999999999999997e-07 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048405+0000", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9410000000000004e-06 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048412+0000", 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8889999999999996e-06 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048417+0000", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6450000000000004e-06 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048636+0000", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00021942199999999999 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048652+0000", 2024-09-12T21:52:41.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6121e-05 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271703 5.7 5.324df267 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.049167+0000", 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9999237, 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7018000000000002e-05, 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:41.063 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271703 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049167+0000", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049167+0000", 2024-09-12T21:52:41.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049168+0000", 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4900000000000005e-07 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049172+0000", 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1289999999999998e-06 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049180+0000", 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7849999999999997e-06 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049187+0000", 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9290000000000001e-06 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271704 5.f 5.1c51807f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.049204+0000", 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.999887, 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9566000000000004e-05, 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271704 2024-09-12T21:52:41.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049204+0000", 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049204+0000", 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049204+0000", 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3700000000000001e-07 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049206+0000", 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.1619999999999998e-06 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049212+0000", 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7180000000000001e-06 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049215+0000", 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3809999999999999e-06 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049261+0000", 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.57e-05 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271705 5.6 5:64c469cf:::benchmark_data_smithi053_32461_object122389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.049235+0000", 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.999855, 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100072, 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "reached pg", 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271705 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049235+0000", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049235+0000", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049236+0000", 2024-09-12T21:52:41.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6199999999999998e-07 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049239+0000", 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.7190000000000001e-06 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049245+0000", 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4819999999999999e-06 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049251+0000", 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7379999999999999e-06 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.049293+0000", 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2089000000000003e-05 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:271696 5.7 5:e75bbf45:::benchmark_data_smithi053_32461_object122380:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.046085+0000", 2024-09-12T21:52:41.074 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.003005626, 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033119030000000002, 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 271696 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046085+0000", 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046085+0000", 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046085+0000", 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2099999999999996e-07 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046088+0000", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9119999999999998e-06 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046095+0000", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0729999999999999e-06 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046101+0000", 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2780000000000001e-06 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046269+0000", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016842699999999999 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046384+0000", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000114527 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.046492+0000", 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010863599999999999 2024-09-12T21:52:41.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048464+0000", 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0019716249999999999 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:271697 5.5 e63/21 5:a78a03d6:::benchmark_data_smithi053_32461_object122381:head v 63'16917, mlcod=63'16913)", 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.047166+0000", 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0019241270000000001, 2024-09-12T21:52:41.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023272309999999999, 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047166+0000", 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047166+0000", 2024-09-12T21:52:41.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047167+0000", 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.39e-07 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047171+0000", 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.968e-06 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.081 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047178+0000", 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4540000000000001e-06 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047183+0000", 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.938e-06 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047218+0000", 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5002999999999997e-05 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.082 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047233+0000", 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4883e-05 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:271695 5.c e63/21 5:337f972f:::benchmark_data_smithi053_32461_object122379:head v 63'16845, mlcod=63'16842)", 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:41.047968+0000", 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0011226929999999999, 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015853729999999999, 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:41.083 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047968+0000", 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047968+0000", 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.084 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047968+0000", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8899999999999999e-07 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047977+0000", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3590000000000008e-06 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047985+0000", 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3999999999999992e-06 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.085 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.047991+0000", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0569999999999998e-06 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048033+0000", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2203000000000002e-05 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:41.048052+0000", 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8420999999999999e-05 2024-09-12T21:52:41.086 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 9 2024-09-12T21:52:41.087 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:41.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:41.128 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.128+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:41.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:41.208 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.207+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:41.275 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:41.275 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:41.275 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:41.275 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:41.275 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:41.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:41.309 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:41.308+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:41.313 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:41.332 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:41.333 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:41.333 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:41.336 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:41.336 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:41.409 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.409+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:41.479 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:41.479 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:41.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:41.536 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:41.535+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:41.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:52:41.611 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.611+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:41.649 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:41.649 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:41.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:41.746 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:41.745+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:41.813 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:41.811+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:41.856 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:41.856 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:41.867 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:41.913 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:41.913+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.015 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:42.013+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:42.065 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:42.065 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:42.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:42.122 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.122+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.216 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.216+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.228 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:42.228 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:42.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:42.324 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.323+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.417 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.417+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.427 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:42.427 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:42.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:42.523 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.523+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:52:42.619 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:42.618+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:42.625 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:42.626 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:42.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:42.721 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:42.719+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:42.794 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:42.795 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:42.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:42.848 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:42.847+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:42.922 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:42.921+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:43.001 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:43.001 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:43.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:43.060 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:43.059+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:43.123 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:43.123+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:43.169 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:43.169 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:43.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:43.224 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:43.223+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:43.325 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:43.324+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:43.333 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:43.333 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:43.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:43.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:43.428 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:43.428+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:43.469 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:43.488 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:43.489 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:43.492 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:43.493 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:43.527 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:43.526+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:43.535 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:43.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:43.536 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:43.536 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:43.536 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:43.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:43.627 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:43.626+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:43.728 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:43.727+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.744 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.431196168, 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:43.751 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.429574772999999, 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:43.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:43.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.757 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.429484744000007, 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:43.758 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.759 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.760 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:43.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.762 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.763 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:43.764 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.426313042999993, 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.765 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.766 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:43.768 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.769 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.770 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.425792787999995, 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.771 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:43.772 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.773 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:43.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:43.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.419209301999999, 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.777 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.778 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.779 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:43.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:43.781 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:43.782 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 82.406599490000005, 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.783 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.784 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:43.785 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.786 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.787 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.788 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.233353342000001, 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.789 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.790 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:43.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:43.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.800 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.230802578999999, 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:43.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:43.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.807 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.228226892000002, 2024-09-12T21:52:43.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:43.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.812 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.815 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.226039669999999, 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.816 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:43.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:43.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.220951042999999, 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.823 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.824 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.825 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.826 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:43.827 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.828 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:43.829 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.209777756999998, 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.830 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.831 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:43.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.833 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.834 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:43.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.836 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.205984479000001, 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.837 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.838 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.839 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:43.840 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.841 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.842 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.843 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.198190431999997, 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.844 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:43.845 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.846 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:43.847 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.848 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.849 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:43.850 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.166563676999999, 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.851 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:43.852 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.853 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.854 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:43.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.856 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:43.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.147704169000001, 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.858 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:43.859 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.860 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:43.861 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.862 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:43.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.864 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.142910143999998, 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.865 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.866 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.867 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.868 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:43.869 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.870 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.871 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.141605998999999, 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.872 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.873 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:43.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.875 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.876 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:43.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.878 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 38.131653264000001, 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:43.879 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:43.880 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.881 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.882 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:43.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:43.884 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.885 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.886 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:43.886 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:43.886 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:43.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:43.888 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:43.886+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:43.988 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:43.987+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:44.043 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280868 5.0 5:0bb8dcb1:::benchmark_data_smithi053_32461_object131552:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.038973+0000", 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002861602, 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028910540000000001, 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280868 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038973+0000", 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038973+0000", 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038974+0000", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1600000000000001e-07 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038977+0000", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9500000000000001e-06 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038986+0000", 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6569999999999992e-06 2024-09-12T21:52:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038991+0000", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.853e-06 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041579+0000", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025881350000000001 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041683+0000", 2024-09-12T21:52:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103347 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280871 5.0 5.cea32ac0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.039977+0000", 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001858277, 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001960959, 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280871 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039977+0000", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039977+0000", 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039977+0000", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039982+0000", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1919999999999998e-06 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039992+0000", 2024-09-12T21:52:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0465999999999999e-05 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.039999+0000", 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6100000000000002e-06 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280872 5.0 5.cf85d810 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.040922+0000", 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00091288700000000003, 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001071287, 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280872 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040922+0000", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040922+0000", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040923+0000", 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8500000000000001e-07 2024-09-12T21:52:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040926+0000", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040934+0000", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6690000000000006e-06 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040939+0000", 2024-09-12T21:52:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280873 5.5 5:a31847fb:::benchmark_data_smithi053_32461_object131557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.040980+0000", 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00085455100000000005, 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010692270000000001, 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280873 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040980+0000", 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040980+0000", 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040981+0000", 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8699999999999995e-07 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040983+0000", 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3410000000000001e-06 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040990+0000", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0149999999999998e-06 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040995+0000", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1379999999999998e-06 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041033+0000", 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7808000000000001e-05 2024-09-12T21:52:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041130+0000", 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041231+0000", 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101277 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280875 5.8 5.818da308 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.041152+0000", 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00068331100000000003, 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097038199999999999, 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280875 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041152+0000", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041152+0000", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041152+0000", 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9599999999999998e-07 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041156+0000", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6069999999999999e-06 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041165+0000", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6740000000000003e-06 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041171+0000", 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8449999999999997e-06 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280879 5.5 5.13db9085 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.041653+0000", 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00018190400000000001, 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052220599999999999, 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280879 2024-09-12T21:52:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041653+0000", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041653+0000", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041654+0000", 2024-09-12T21:52:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0900000000000001e-07 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041658+0000", 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9929999999999997e-06 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041665+0000", 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7880000000000007e-06 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041671+0000", 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0449999999999997e-06 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280880 5.e 5:7795ab7a:::benchmark_data_smithi053_32461_object131564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.041792+0000", 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3310999999999999e-05, 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00043809200000000001, 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280880 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041792+0000", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041792+0000", 2024-09-12T21:52:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041792+0000", 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5300000000000003e-07 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041796+0000", 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.602e-06 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041803+0000", 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3089999999999998e-06 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041809+0000", 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0499999999999997e-06 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041854+0000", 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4297e-05 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041964+0000", 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011008 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:280878 5.7 e64/21 5:ed22735c:::benchmark_data_smithi053_32461_object131562:head v 64'17558, mlcod=64'17556)", 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.041830+0000", 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5680000000000001e-06, 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045670800000000001, 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041830+0000", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041830+0000", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041831+0000", 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3799999999999998e-07 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041835+0000", 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041841+0000", 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041846+0000", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5210000000000004e-06 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041894+0000", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8000000000000001e-05 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041912+0000", 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8099000000000001e-05 2024-09-12T21:52:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280856 5.8 5:11d99d28:::benchmark_data_smithi053_32461_object131540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.035500+0000", 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063343560000000002, 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068193660000000003, 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280856 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035500+0000", 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035500+0000", 2024-09-12T21:52:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035501+0000", 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1999999999999998e-07 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035505+0000", 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.019e-06 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035515+0000", 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2e-06 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.035522+0000", 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2710000000000003e-06 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036029+0000", 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00050728199999999996 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036136+0000", 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106617 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280860 5.8 5:1c0eae5a:::benchmark_data_smithi053_32461_object131544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.036512+0000", 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053230730000000002, 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058438800000000001, 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280860 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036512+0000", 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036512+0000", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036512+0000", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2800000000000002e-07 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036514+0000", 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2220000000000001e-06 2024-09-12T21:52:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036521+0000", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2369999999999997e-06 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036525+0000", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6299999999999997e-06 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038054+0000", 2024-09-12T21:52:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015284299999999999 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.038177+0000", 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012296400000000001 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280862 5.8 5:1fb72889:::benchmark_data_smithi053_32461_object131546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.036799+0000", 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050361929999999996, 2024-09-12T21:52:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055903430000000002, 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280862 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036799+0000", 2024-09-12T21:52:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036799+0000", 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036799+0000", 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3099999999999997e-07 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036802+0000", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1590000000000002e-06 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036810+0000", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5639999999999999e-06 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.036815+0000", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3260000000000003e-06 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040080+0000", 2024-09-12T21:52:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032645629999999998 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.040209+0000", 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129345 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:280863 5.8 5:1613ecb1:::benchmark_data_smithi053_32461_object131547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:44.037535+0000", 2024-09-12T21:52:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042997010000000004, 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048868719999999996, 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 280863 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037535+0000", 2024-09-12T21:52:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037535+0000", 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037536+0000", 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.16e-07 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037540+0000", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0029999999999996e-06 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037557+0000", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6837000000000002e-05 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.037563+0000", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6640000000000001e-06 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041595+0000", 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040315639999999996 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:44.041720+0000", 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012522 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-09-12T21:52:44.090 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:44.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:44.092 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:44.090+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:44.194 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:44.192+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:44.282 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:44.282 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:44.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:44.294 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:44.293+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:44.394 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:44.394+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:44.492 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 92.149094237, 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 92.147772711000002, 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 92.147284868, 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:44.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:44.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:44.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:44.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 92.146557486999995, 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:44.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.528 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:44.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:44.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:44.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:44.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.179713436, 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.179585977000002, 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.179527356999998, 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.177415710999995, 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.175758768999998, 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.174809170000003, 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.170585083000006, 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.168231544999998, 2024-09-12T21:52:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:44.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:44.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 83.166608353000001, 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:44.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:44.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.807262332999997, 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:44.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.805545543999997, 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:44.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:44.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.804806737, 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:44.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.804771027999998, 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:44.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:44.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.800472921999997, 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:44.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:44.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.796593197, 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:44.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:44.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:44.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.794342774, 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:44.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:44.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:44.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:44.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:44.634 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:44.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T21:52:44.635 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:44.634+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:44.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:44.735 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:44.735+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:44.791 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:44.791 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:44.791 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.791 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:283170 5.c e64/21 5:321bb1e6:::benchmark_data_smithi053_32461_object133854:head v 64'17548, mlcod=64'17546)", 2024-09-12T21:52:44.791 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.785253+0000", 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0033376809999999999, 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0033532969999999999, 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785253+0000", 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.792 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785253+0000", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785253+0000", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5199999999999997e-07 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785258+0000", 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8709999999999996e-06 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.793 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785270+0000", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1518999999999999e-05 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785276+0000", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4320000000000004e-06 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785334+0000", 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7763999999999998e-05 2024-09-12T21:52:44.794 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785352+0000", 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.7604999999999998e-05 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788602+0000", 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032501409999999998 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.795 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:283175 5.c e64/21 5:3539cd5f:::benchmark_data_smithi053_32461_object133859:head v 64'17549, mlcod=64'17546)", 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.787145+0000", 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001445092, 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0015020700000000001, 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787145+0000", 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.796 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787145+0000", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787146+0000", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0100000000000005e-07 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787151+0000", 2024-09-12T21:52:44.797 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6129999999999997e-06 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787162+0000", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1099e-05 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787168+0000", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.657e-06 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787212+0000", 2024-09-12T21:52:44.798 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3313999999999999e-05 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787231+0000", 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.9074000000000001e-05 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:283178 5.1 5:8476e396:::benchmark_data_smithi053_32461_object133862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.787829+0000", 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00076189200000000002, 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00085637899999999999, 2024-09-12T21:52:44.799 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 283178 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787829+0000", 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.800 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787829+0000", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787830+0000", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0419999999999999e-06 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787834+0000", 2024-09-12T21:52:44.801 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7090000000000001e-06 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787845+0000", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0728e-05 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787853+0000", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6170000000000001e-06 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787904+0000", 2024-09-12T21:52:44.802 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1261999999999998e-05 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787977+0000", 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2784e-05 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788052+0000", 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4994999999999996e-05 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.803 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:283157 5.1 e64/36)", 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.788278+0000", 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00031207000000000001, 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00045649800000000001, 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.804 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788278+0000", 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788278+0000", 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788279+0000", 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0800000000000004e-07 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.805 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788283+0000", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.557e-06 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788294+0000", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0949e-05 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.788300+0000", 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.28e-06 2024-09-12T21:52:44.806 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:283157 5.1 5:88162bb0:::benchmark_data_smithi053_32461_object133841:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.779847+0000", 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0087431490000000004, 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0089150779999999999, 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:44.807 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 283157 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779847+0000", 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779847+0000", 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.808 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779848+0000", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0860000000000001e-06 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779853+0000", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4939999999999997e-06 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779867+0000", 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3771000000000001e-05 2024-09-12T21:52:44.809 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.779875+0000", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2099999999999993e-06 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.783233+0000", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00335842 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.783355+0000", 2024-09-12T21:52:44.810 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012168 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.783438+0000", 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3399000000000006e-05 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.786264+0000", 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028256100000000001 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.811 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:283159 5.1 5:83044ac4:::benchmark_data_smithi053_32461_object133843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.780890+0000", 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0077003469999999997, 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0079126519999999992, 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 283159 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.812 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780890+0000", 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780890+0000", 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.813 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780891+0000", 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780895+0000", 2024-09-12T21:52:44.816 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.267e-06 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780905+0000", 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3710000000000006e-06 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.780911+0000", 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3969999999999999e-06 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.817 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.784788+0000", 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038772030000000001 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.784899+0000", 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000110863 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.785011+0000", 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011227599999999999 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.818 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.787768+0000", 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027563959999999999 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:283163 5.1 5:85d80f04:::benchmark_data_smithi053_32461_object133847:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:44.781865+0000", 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0067251020000000002, 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.006985949, 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:44.819 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 283163 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781865+0000", 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.820 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781865+0000", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781866+0000", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.54e-07 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781870+0000", 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6540000000000001e-06 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.821 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781878+0000", 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0260000000000007e-06 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.781884+0000", 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7370000000000003e-06 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:44.822 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.786291+0000", 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044074910000000004 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.786411+0000", 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011972399999999999 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:44.786544+0000", 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302400000000001 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:44.824 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 7 2024-09-12T21:52:44.824 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:44.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:44.836 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:44.835+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:44.937 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:44.936+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.016 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:45.016 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:45.016 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:45.016 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:45.016 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:45.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:45.038 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.037+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.138 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.137+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.868699961000004, 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.183 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:45.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:45.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:45.187 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.867078566000004, 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.188 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:45.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.192 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.193 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.866988536999997, 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.194 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.195 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:45.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.197 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.198 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:45.199 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.863816835999998, 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.200 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.201 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.202 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:45.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.204 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.205 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.863296581, 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.206 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.207 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:45.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.209 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.210 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.211 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.856713095000003, 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.212 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:45.213 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.215 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.216 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:45.217 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 83.844103282999995, 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.218 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.219 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.220 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.221 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:45.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.225 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.226 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.670857134999999, 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.228 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:45.229 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.230 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.231 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.232 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.233 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.668306372000004, 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.234 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.235 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.236 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:45.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.238 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:45.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.240 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.665730685, 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.241 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.242 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.243 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:45.244 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.245 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.246 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:45.247 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.663543463000003, 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.248 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.249 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.250 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:45.251 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.252 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.253 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:45.254 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.658454835999997, 2024-09-12T21:52:45.255 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.256 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:45.258 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.259 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:45.260 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.262 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.647281550000002, 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:45.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:45.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.643488271999999, 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:45.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.274 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.635694225000002, 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.276 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:45.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:45.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.282 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.604067469999997, 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.283 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:45.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:45.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.585207961999998, 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:45.290 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:45.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:45.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:45.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.580413937000003, 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:45.297 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:45.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:45.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.579109791999997, 2024-09-12T21:52:45.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:45.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:45.309 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:45.310 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 39.569157056999998, 2024-09-12T21:52:45.311 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.312 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.313 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.314 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.315 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:45.316 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:45.317 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:45.318 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:45.320 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:45.321 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.318+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.420 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:45.419+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:45.474 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:45.474 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285295 5.b 5:da818efb:::benchmark_data_smithi053_32461_object135979:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.472600+0000", 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00044820299999999999, 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047195100000000002, 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285295 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472600+0000", 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472600+0000", 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472601+0000", 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0400000000000005e-07 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472605+0000", 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.189e-06 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472614+0000", 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6770000000000001e-06 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472620+0000", 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5910000000000001e-06 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472669+0000", 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8795000000000003e-05 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472780+0000", 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011102100000000001 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:285276 5.7 e64/21 5:e49200c1:::benchmark_data_smithi053_32461_object135960:head v 64'17838, mlcod=64'17835)", 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.468388+0000", 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046599759999999997, 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047555599999999998, 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468388+0000", 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468388+0000", 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468389+0000", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.15e-07 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468392+0000", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2660000000000002e-06 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468398+0000", 2024-09-12T21:52:45.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3049999999999998e-06 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468402+0000", 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2069999999999997e-06 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468432+0000", 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9980000000000001e-05 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.468448+0000", 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5758000000000001e-05 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285284 5.e 5:751a7786:::benchmark_data_smithi053_32461_object135968:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.469454+0000", 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035945230000000001, 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037463470000000001, 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:45.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285284 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469454+0000", 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469454+0000", 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469455+0000", 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0979999999999999e-06 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469460+0000", 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0780000000000003e-06 2024-09-12T21:52:45.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469471+0000", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1240000000000001e-05 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469480+0000", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9190000000000005e-06 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469538+0000", 2024-09-12T21:52:45.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8050999999999997e-05 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469653+0000", 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115077 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.473120+0000", 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034669340000000001 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:45.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.473160+0000", 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9400999999999998e-05 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:285281 5.7 e64/21 5:e4d54a0b:::benchmark_data_smithi053_32461_object135965:head v 64'17839, mlcod=64'17835)", 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.469636+0000", 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034127200000000002, 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036398210000000001, 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469636+0000", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469636+0000", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469636+0000", 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8000000000000005e-07 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469645+0000", 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6519999999999995e-06 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469654+0000", 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4700000000000008e-06 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.469668+0000", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3254e-05 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470029+0000", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036095300000000001 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470059+0000", 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0023999999999999e-05 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285286 5.5 5:a7f38638:::benchmark_data_smithi053_32461_object135970:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.470486+0000", 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025618250000000002, 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028456060000000001, 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285286 2024-09-12T21:52:45.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470486+0000", 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470486+0000", 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470487+0000", 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4900000000000005e-07 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470492+0000", 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9289999999999997e-06 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470501+0000", 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2709999999999998e-06 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470508+0000", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8889999999999996e-06 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470558+0000", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9845000000000001e-05 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470668+0000", 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001094 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470771+0000", 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010301099999999999 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285289 5.5 5:a7a496b5:::benchmark_data_smithi053_32461_object135973:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.470825+0000", 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022231880000000001, 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025747209999999999, 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285289 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470825+0000", 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470825+0000", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470826+0000", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5000000000000001e-07 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470830+0000", 2024-09-12T21:52:45.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0749999999999999e-06 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470839+0000", 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6670000000000002e-06 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470846+0000", 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472518+0000", 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016728820000000001 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472635+0000", 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011696000000000001 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:45.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472741+0000", 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521100000000001 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:285282 5.7 e64/21 5:e49aa1ef:::benchmark_data_smithi053_32461_object135966:head v 64'17840, mlcod=64'17835)", 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.470975+0000", 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020735319999999999, 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024944839999999999, 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470975+0000", 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470975+0000", 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470975+0000", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2300000000000001e-07 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470980+0000", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4020000000000004e-06 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470987+0000", 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2590000000000003e-06 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.470992+0000", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4260000000000002e-06 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471784+0000", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079123300000000002 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471802+0000", 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8173e-05 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285293 5.3 5:c9a542f3:::benchmark_data_smithi053_32461_object135977:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.471253+0000", 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017952459999999999, 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022772729999999998, 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285293 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471253+0000", 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471253+0000", 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471254+0000", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3499999999999996e-07 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471256+0000", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6790000000000001e-06 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471262+0000", 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6210000000000001e-06 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471265+0000", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5880000000000002e-06 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471304+0000", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.888e-05 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471408+0000", 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103663 2024-09-12T21:52:45.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.471505+0000", 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7181000000000003e-05 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:285294 5.4 5:21a4a1dc:::benchmark_data_smithi053_32461_object135978:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:45.472458+0000", 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00059014799999999997, 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001112944, 2024-09-12T21:52:45.509 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 285294 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472458+0000", 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472458+0000", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472459+0000", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.37e-07 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472462+0000", 2024-09-12T21:52:45.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4450000000000001e-06 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472475+0000", 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3169e-05 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472483+0000", 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4939999999999997e-06 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472544+0000", 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1592000000000003e-05 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:45.472652+0000", 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010723899999999999 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-09-12T21:52:45.513 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:45.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:45.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:45.521 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:45.520+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:45.600 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-09-12T21:52:45.621 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:45.621+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:45.653 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:45.653 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:45.672 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:45.673 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:45.673 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:45.676 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:45.676 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:45.677 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:45.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:45.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:45.733 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.732+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.823 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.822+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:45.846 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:45.847 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:45.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:45.924 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:45.923+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.007 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.008 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:46.025 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.024+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.126 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.125+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.176 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:46.226 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.225+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-09-12T21:52:46.327 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:46.326+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:46.336 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.336 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.350 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:46.428 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.427+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.509 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.509 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:46.563 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.562+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.630 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.630+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:46.709 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.709 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:46.731 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:46.730+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:46.832 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:46.831+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:46.919 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:46.919 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:46.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:46.933 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:46.932+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.034 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.033+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.077 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:47.077 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:47.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:47.135 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:47.134+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:47.235 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.234+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.237 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:47.237 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:47.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:47.336 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.335+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.437 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.436+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.437 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:47.438 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:47.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:47.537 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:47.536+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:47.607 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:47.607 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:47.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T21:52:47.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:47.665 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.664+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:47.738 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:47.737+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:47.775 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:47.776 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:47.790 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:47.824 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:47.840 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:47.839+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:47.844 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:47.847 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:47.848 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:47.941 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:47.940+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.643991227000001, 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:47.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:47.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:47.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:47.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:47.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:47.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.642669701000003, 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:47.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:47.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:47.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.642181858000001, 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:47.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:48.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:48.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.641454476999996, 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:48.004 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:48.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.674610426000001, 2024-09-12T21:52:48.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:48.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:48.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.674482967000003, 2024-09-12T21:52:48.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:48.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.674424346999999, 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:48.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:48.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.672312700999996, 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:48.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:48.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.670655758999999, 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:48.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:48.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.669706160000004, 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:48.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:48.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:48.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:48.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.665482073000007, 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:48.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:48.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.663128534999998, 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.661505343000002, 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:48.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:48.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:48.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.302159322999998, 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:48.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:48.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.300442533999998, 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:48.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.299703727000001, 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:48.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:48.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:48.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.299668017999998, 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:48.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:48.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.295369911999998, 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:48.089 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:48.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.291490187000001, 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:48.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:48.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:48.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.289239764000001, 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.108 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:48.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:48.110 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:48.108+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:48.210 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.209+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293787 5.d 5:bea4b742:::benchmark_data_smithi053_32461_object144471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.253708+0000", 2024-09-12T21:52:48.260 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0050873189999999999, 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0051150529999999996, 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293787 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253708+0000", 2024-09-12T21:52:48.261 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253708+0000", 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253709+0000", 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.68e-07 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.262 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253713+0000", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1339999999999997e-06 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253723+0000", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0212e-05 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253730+0000", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7089999999999996e-06 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253782+0000", 2024-09-12T21:52:48.263 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1712999999999998e-05 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.253903+0000", 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012118299999999999 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293788 5.a 5:5e69fe82:::benchmark_data_smithi053_32461_object144472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.254015+0000", 2024-09-12T21:52:48.264 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0047806519999999998, 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.004883353, 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293788 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254015+0000", 2024-09-12T21:52:48.265 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254015+0000", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254015+0000", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3600000000000003e-07 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254018+0000", 2024-09-12T21:52:48.266 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.818e-06 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254024+0000", 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6450000000000002e-06 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254028+0000", 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9960000000000004e-06 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.267 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254066+0000", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8509e-05 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254179+0000", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000112737 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254286+0000", 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000106844 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.268 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257549+0000", 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0032634740000000001 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293793 5.6 5:6dfd908d:::benchmark_data_smithi053_32461_object144477:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.254063+0000", 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0047325020000000004, 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0049145480000000004, 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.269 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293793 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254063+0000", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254063+0000", 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254063+0000", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1899999999999998e-07 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254066+0000", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3140000000000002e-06 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254072+0000", 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6239999999999996e-06 2024-09-12T21:52:48.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254078+0000", 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8259999999999998e-06 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254156+0000", 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7551000000000003e-05 2024-09-12T21:52:48.272 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254260+0000", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010385700000000001 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.254361+0000", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000101681 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256705+0000", 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0023438439999999999 2024-09-12T21:52:48.273 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:293790 5.5 e65/21 5:add59870:::benchmark_data_smithi053_32461_object144474:head v 65'18244, mlcod=65'18241)", 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.255617+0000", 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031783779999999999, 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034410640000000002, 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.274 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255617+0000", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255617+0000", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255617+0000", 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9999999999999998e-07 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.275 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255622+0000", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6959999999999996e-06 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255631+0000", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9919999999999996e-06 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255637+0000", 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8329999999999999e-06 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.276 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255674+0000", 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7215000000000002e-05 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255690+0000", 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5953000000000001e-05 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293796 5.d 5:b397541c:::benchmark_data_smithi053_32461_object144480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.255654+0000", 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0031417189999999998, 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0034626359999999998, 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293796 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255654+0000", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255654+0000", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255655+0000", 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1100000000000005e-07 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.279 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255658+0000", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4240000000000002e-06 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255667+0000", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2760000000000006e-06 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255674+0000", 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8340000000000001e-06 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.280 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255714+0000", 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9682999999999999e-05 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.255841+0000", 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012761599999999999 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.281 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293798 5.d 5:b0162d5c:::benchmark_data_smithi053_32461_object144482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.256468+0000", 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0023272610000000002, 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027001130000000001, 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293798 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.282 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256468+0000", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256468+0000", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256469+0000", 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7999999999999995e-07 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256472+0000", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.6270000000000002e-06 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256480+0000", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6469999999999998e-06 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.256485+0000", 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5959999999999997e-06 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.284 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257375+0000", 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00089035600000000003 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257520+0000", 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014517600000000001 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.285 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:293794 5.5 e65/21 5:a73fb4d9:::benchmark_data_smithi053_32461_object144478:head v 65'18245, mlcod=65'18241)", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.257755+0000", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001040439, 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001446531, 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257755+0000", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.286 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257755+0000", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257756+0000", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9400000000000005e-07 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257764+0000", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8820000000000001e-06 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.287 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257774+0000", 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0444e-05 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.257780+0000", 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4740000000000002e-06 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258952+0000", 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001171713 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.288 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258968+0000", 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5721000000000001e-05 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293804 5.a 5:504b7f9e:::benchmark_data_smithi053_32461_object144488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.258049+0000", 2024-09-12T21:52:48.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00074660099999999995, 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00118508, 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293804 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.290 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258049+0000", 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258049+0000", 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258050+0000", 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.71e-07 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.291 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258054+0000", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0249999999999996e-06 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258067+0000", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3219e-05 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258075+0000", 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.5050000000000007e-06 2024-09-12T21:52:48.292 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258116+0000", 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0898e-05 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258196+0000", 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0124999999999996e-05 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.293 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258266+0000", 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9740999999999995e-05 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:293788 5.a e65/51)", 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.258193+0000", 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00060277699999999998, 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010758020000000001, 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:48.294 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258193+0000", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258193+0000", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258193+0000", 2024-09-12T21:52:48.295 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.82e-07 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258199+0000", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.553e-06 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258209+0000", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013e-05 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258215+0000", 2024-09-12T21:52:48.296 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0460000000000002e-06 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293806 5.6 5:6e763db3:::benchmark_data_smithi053_32461_object144490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.258337+0000", 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00045819799999999999, 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00095615299999999995, 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.297 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293806 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258337+0000", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258337+0000", 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.298 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258338+0000", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9299999999999997e-07 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258347+0000", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7399999999999993e-06 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258359+0000", 2024-09-12T21:52:48.299 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1805e-05 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258367+0000", 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2609999999999993e-06 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258413+0000", 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5932e-05 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.300 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258534+0000", 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000121062 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258638+0000", 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000104069 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:293809 5.9 5:9efd548a:::benchmark_data_smithi053_32461_object144493:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.258665+0000", 2024-09-12T21:52:48.301 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00013032300000000001, 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00066477300000000001, 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 293809 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258665+0000", 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.302 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258665+0000", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258666+0000", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7499999999999999e-07 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258670+0000", 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9940000000000002e-06 2024-09-12T21:52:48.303 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258680+0000", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0582e-05 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258687+0000", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7870000000000004e-06 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258731+0000", 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4249999999999998e-05 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.304 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258855+0000", 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000123375 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:293808 5.2 e65/36)", 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:48.258922+0000", 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4294967295.9998741, 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00044026800000000001, 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.305 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258922+0000", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258922+0000", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258922+0000", 2024-09-12T21:52:48.306 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3499999999999996e-07 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258927+0000", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0350000000000001e-06 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258936+0000", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2199999999999998e-06 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:48.258942+0000", 2024-09-12T21:52:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0100000000000001e-06 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 12 2024-09-12T21:52:48.308 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:48.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:48.310 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.309+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.412 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.410+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.456 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:48.456 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:48.456 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:48.456 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:48.456 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:48.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:48.512 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.511+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-09-12T21:52:48.613 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.612+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.622 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.309298866999995, 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.623 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:48.625 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:48.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.307677471999995, 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.630 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:48.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:48.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:48.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:48.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.307587443000003, 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:48.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:48.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.304415742000003, 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.642 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:48.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.303895487000005, 2024-09-12T21:52:48.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:48.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:48.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.652 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:48.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.297312000999995, 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.655 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:48.656 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.657 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.658 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.659 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.660 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 87.284702189000001, 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.661 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:48.662 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:48.663 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.664 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.666 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.111456040999997, 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:48.668 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.669 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.670 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:48.671 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.673 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.108905278000002, 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.674 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.675 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:48.677 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.678 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.679 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:48.680 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.106329590999998, 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.681 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.682 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.683 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.684 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.685 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.686 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:48.687 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.104142369000002, 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.692 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.692 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.692 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:48.692 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.693 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:48.694 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:48.695 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.696 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.099053742000002, 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:48.697 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.698 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.699 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.700 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:48.701 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.703 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.087880456000001, 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:48.704 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.705 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:48.706 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.707 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:48.708 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:48.709 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.710 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.084087177999997, 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.711 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.712 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.713 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:48.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:48.715 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:48.716 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.717 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.076293131, 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.718 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:48.719 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.720 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.721 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.722 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:48.723 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.044666376000002, 2024-09-12T21:52:48.724 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.725 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.726 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:48.727 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.728 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:48.729 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.025806867999997, 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.731 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.732 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.733 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.734 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.735 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.021012843000001, 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.738 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.740 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.741 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.742 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:48.743 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.019708698000002, 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.745 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.746 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.747 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.748 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.749 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 43.009755963000003, 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:48.750 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.751 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:48.752 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.753 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.754 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:48.755 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:48.756 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:48.757 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:48.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:48.759 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.757+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.859 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:48.858+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:48.910 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295807 5.e 5:7431422d:::benchmark_data_smithi053_32461_object146491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.906665+0000", 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022367429999999998, 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022579840000000002, 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295807 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906665+0000", 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906665+0000", 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906665+0000", 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5799999999999999e-07 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906668+0000", 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-12T21:52:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906675+0000", 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5370000000000003e-06 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906679+0000", 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.729e-06 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907362+0000", 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068270699999999995 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907468+0000", 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106166 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295808 5.8 5:1722e56b:::benchmark_data_smithi053_32461_object146492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.907036+0000", 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001865397, 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001928185, 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295808 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907036+0000", 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907036+0000", 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907037+0000", 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7700000000000004e-07 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907040+0000", 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1310000000000002e-06 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907051+0000", 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1226000000000001e-05 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907066+0000", 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907278+0000", 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000211301 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907353+0000", 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5254999999999997e-05 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4635.0:295810 5.a e66/51 5:5ee0b6f0:::benchmark_data_smithi053_32461_object146494:head v 66'18179, mlcod=66'18176)", 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.907379+0000", 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001521955, 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016202040000000001, 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907379+0000", 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907379+0000", 2024-09-12T21:52:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907380+0000", 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9500000000000003e-07 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907385+0000", 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8740000000000003e-06 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907392+0000", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.627e-06 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907398+0000", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.57e-06 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907436+0000", 2024-09-12T21:52:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8498999999999999e-05 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907456+0000", 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9313999999999998e-05 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295811 5.c 5:3296eb81:::benchmark_data_smithi053_32461_object146495:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.907629+0000", 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001272294, 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001401193, 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295811 2024-09-12T21:52:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907629+0000", 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907629+0000", 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907630+0000", 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3099999999999996e-07 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907633+0000", 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2100000000000002e-06 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907642+0000", 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7399999999999993e-06 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907648+0000", 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4479999999999999e-06 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907696+0000", 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7373000000000002e-05 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907796+0000", 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010052699999999999 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.907899+0000", 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102365 2024-09-12T21:52:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295799 5.c 5:317b7a52:::benchmark_data_smithi053_32461_object146483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.903697+0000", 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052045060000000002, 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053723299999999998, 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295799 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903697+0000", 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903697+0000", 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903697+0000", 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2799999999999996e-07 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903700+0000", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9490000000000001e-06 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903710+0000", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1779999999999992e-06 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903716+0000", 2024-09-12T21:52:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0410000000000003e-06 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905666+0000", 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019505620000000001 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905766+0000", 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9774999999999999e-05 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905868+0000", 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101828 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295800 5.3 5:cdabfaf6:::benchmark_data_smithi053_32461_object146484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.903732+0000", 2024-09-12T21:52:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0051692910000000003, 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053736879999999997, 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295800 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903732+0000", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903732+0000", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903733+0000", 2024-09-12T21:52:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.39e-07 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903735+0000", 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1959999999999998e-06 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903744+0000", 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903748+0000", 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8049999999999997e-06 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906045+0000", 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022967550000000002 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906151+0000", 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105494 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.906213+0000", 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2298000000000006e-05 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.908319+0000", 2024-09-12T21:52:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021064510000000001 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295801 5.8 5:17017468:::benchmark_data_smithi053_32461_object146485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.903755+0000", 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0051465189999999996, 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005396166, 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295801 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903755+0000", 2024-09-12T21:52:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903755+0000", 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903755+0000", 2024-09-12T21:52:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7800000000000002e-07 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903757+0000", 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.869e-06 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903764+0000", 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9550000000000003e-06 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903769+0000", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.544e-06 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903799+0000", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0574000000000002e-05 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.903926+0000", 2024-09-12T21:52:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012728899999999999 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295803 5.4 5:2023dcd2:::benchmark_data_smithi053_32461_object146487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.904210+0000", 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046910629999999997, 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049790980000000004, 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295803 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904210+0000", 2024-09-12T21:52:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904210+0000", 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904211+0000", 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7400000000000003e-07 2024-09-12T21:52:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904215+0000", 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6660000000000001e-06 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904224+0000", 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8439999999999993e-06 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.904231+0000", 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2910000000000004e-06 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905477+0000", 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012461589999999999 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905580+0000", 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010257200000000001 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:295805 5.e 5:77694bb5:::benchmark_data_smithi053_32461_object146489:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:48.905264+0000", 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036371009999999998, 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003983037, 2024-09-12T21:52:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 295805 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905264+0000", 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905264+0000", 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905265+0000", 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4600000000000003e-07 2024-09-12T21:52:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905270+0000", 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6099999999999999e-06 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905282+0000", 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1993e-05 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905288+0000", 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.686e-06 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905355+0000", 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6749999999999996e-05 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:48.905461+0000", 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010576100000000001 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-09-12T21:52:48.957 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:48.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:48.959 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:48.959+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.060 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.060+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.156 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:49.156 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:49.157 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:49.157 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:49.162 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.161+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:49.262 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.262+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:49.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.978508078000004, 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:49.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:49.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:49.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.977186552000006, 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:49.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:49.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.976698709000004, 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:49.335 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:49.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:49.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.975971328, 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:49.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:49.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:49.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.009127277000005, 2024-09-12T21:52:49.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:49.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:49.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:49.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.355 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.008999818000007, 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:49.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:49.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.361 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.008941198000002, 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.362 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:49.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:49.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.006829551999999, 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:49.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:49.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.005172610000002, 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:49.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:49.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.004223010999993, 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:49.383 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:49.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.999998923999996, 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:49.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:49.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:49.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.997645386000002, 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:49.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:49.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:49.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.996022194000005, 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:49.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.636676174000002, 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:49.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:49.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.634959385000002, 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:49.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:49.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.634220577999997, 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:49.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:49.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:49.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:49.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.634184869000002, 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:49.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:49.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.629886763000002, 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:49.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:49.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.626007037999997, 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:49.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:49.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:49.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.623756614999998, 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:49.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:49.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:49.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:49.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:49.460 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:49.462 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:49.460+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:49.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:49.563 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.562+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.611 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:49.611 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:49.611 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.611 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297966 5.f 5:f90e1839:::benchmark_data_smithi053_32461_object148650:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.608962+0000", 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.001411285, 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.001433875, 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297966 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.612 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608962+0000", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608962+0000", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608962+0000", 2024-09-12T21:52:49.613 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3300000000000001e-07 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608966+0000", 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8149999999999999e-06 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608980+0000", 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.3345e-05 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.614 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.608987+0000", 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7530000000000001e-06 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609030+0000", 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2596999999999999e-05 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609166+0000", 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013589599999999999 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:297952 5.a e66/51)", 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.609433+0000", 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.000940277, 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010412430000000001, 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.616 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609433+0000", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609433+0000", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609433+0000", 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0800000000000004e-07 2024-09-12T21:52:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609437+0000", 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4580000000000002e-06 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609451+0000", 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.4065e-05 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.618 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609457+0000", 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8470000000000001e-06 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297968 5.7 5:e0c1a5ff:::benchmark_data_smithi053_32461_object148652:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.609631+0000", 2024-09-12T21:52:49.619 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00074146499999999996, 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00087016700000000003, 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297968 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609631+0000", 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609631+0000", 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.621 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609632+0000", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.6499999999999999e-07 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609636+0000", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8249999999999998e-06 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609643+0000", 2024-09-12T21:52:49.622 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.4019999999999996e-06 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609649+0000", 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0419999999999999e-06 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609693+0000", 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3798999999999999e-05 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609787+0000", 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4217999999999998e-05 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609906+0000", 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011901899999999999 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.624 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop_reply(client.4635.0:297956 5.a e66/51)", 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.609770+0000", 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00060275599999999997, 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00076708099999999997, 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609770+0000", 2024-09-12T21:52:49.625 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609770+0000", 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609771+0000", 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8400000000000005e-07 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.626 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609774+0000", 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609785+0000", 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0678e-05 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.627 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609792+0000", 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3470000000000004e-06 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297970 5.a 5.106467fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.610005+0000", 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.00036819000000000001, 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00055744099999999999, 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:49.628 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297970 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610005+0000", 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.629 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610005+0000", 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610005+0000", 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8899999999999998e-07 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610010+0000", 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6269999999999999e-06 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610021+0000", 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0556e-05 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610028+0000", 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.148e-06 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_repop(client.4635.0:297963 5.c e66/21 5:34d7685f:::benchmark_data_smithi053_32461_object148647:head v 66'18476, mlcod=66'18471)", 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.610314+0000", 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 5.8428999999999999e-05, 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00027563300000000001, 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "started", 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610314+0000", 2024-09-12T21:52:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610314+0000", 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610315+0000", 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6100000000000001e-07 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610320+0000", 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0669999999999999e-06 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610328+0000", 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5340000000000002e-06 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610332+0000", 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4209999999999997e-06 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.634 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610364+0000", 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1574e-05 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610382+0000", 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.8425999999999999e-05 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297973 5.7 5.a7fe87d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.635 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.610369+0000", 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 4.065e-06, 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00025025999999999998, 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "queued for pg", 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297973 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.636 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610369+0000", 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610369+0000", 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610369+0000", 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9500000000000002e-07 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610373+0000", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4189999999999998e-06 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610384+0000", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1139e-05 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.610389+0000", 2024-09-12T21:52:49.638 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3199999999999999e-06 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297952 5.a 5:59b7e088:::benchmark_data_smithi053_32461_object148636:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.602326+0000", 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0080467720000000006, 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0083218589999999992, 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.639 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297952 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602326+0000", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602326+0000", 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602327+0000", 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.7300000000000005e-07 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602331+0000", 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7459999999999998e-06 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.641 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602340+0000", 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.1390000000000001e-06 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.602347+0000", 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9349999999999997e-06 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.606406+0000", 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0040592730000000004 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.642 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.606534+0000", 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012840700000000001 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.606655+0000", 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000120621 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297956 5.a 5:59d50e8b:::benchmark_data_smithi053_32461_object148640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.643 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.604789+0000", 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.005584159, 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00589866, 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297956 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.644 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604789+0000", 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604789+0000", 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604790+0000", 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1069999999999999e-06 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604794+0000", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.386e-06 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604811+0000", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.6317999999999999e-05 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.604818+0000", 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2169999999999997e-06 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.646 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607641+0000", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0028235410000000002 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607709+0000", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7272000000000002e-05 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607770+0000", 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1104000000000003e-05 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.647 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:297964 5.a 5:5024e43d:::benchmark_data_smithi053_32461_object148648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:49.607140+0000", 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0032328180000000001, 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0035844290000000001, 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "waiting for sub ops", 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.648 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 297964 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607140+0000", 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607140+0000", 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.649 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607141+0000", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607145+0000", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0790000000000002e-06 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607155+0000", 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0419e-05 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.650 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.607162+0000", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.708e-06 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609461+0000", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022990530000000001 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609574+0000", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011301700000000001 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:49.651 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:49.609707+0000", 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013283899999999999 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 10 2024-09-12T21:52:49.652 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:49.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:49.695 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.694+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.765 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:49.764+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:49.822 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Removed 149313 objects 2024-09-12T21:52:49.822 INFO:tasks.radosbench.radosbench.0.smithi053.stdout:Clean up completed and total clean up time :49.4549 2024-09-12T21:52:49.836 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:49.836 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:49.836 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:49.836 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:49.836 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:49.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:49.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T21:52:49.888 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:49.888+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:49.949 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:49.949 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:49.949 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:49.949 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.637100039000003, 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:49.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.951 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.952 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:49.954 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.955 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.635478644000003, 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:49.957 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.958 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.959 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.960 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.961 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.635388614999997, 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.962 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.963 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.964 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:49.965 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:49.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.632216913999997, 2024-09-12T21:52:49.967 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.968 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:49.969 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:49.970 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.971 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.972 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.631696658999999, 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.973 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.975 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:49.976 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:49.977 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.978 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.625113173000003, 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.979 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.982 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:49.983 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.984 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 88.612503360999995, 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.985 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.986 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:49.987 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.988 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.989 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:49.990 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:49.991 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.439257212999998, 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:49.992 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:49.993 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:49.994 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.995 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:49.996 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:49.997 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:49.998 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.436706450000003, 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:49.999 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.000 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:50.001 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.002 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.003 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.004 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.005 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.434130762999999, 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.006 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.007 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.008 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:50.009 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:50.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:50.011 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.012 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.431943541000003, 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.013 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.014 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.017 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:50.018 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.426854914000003, 2024-09-12T21:52:50.019 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.020 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.021 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.022 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:50.024 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.025 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.026 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.415681628000002, 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.027 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.028 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:50.029 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.030 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.031 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:50.032 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.033 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.411888349999998, 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.034 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:50.035 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:50.036 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.037 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.038 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.039 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.404094303000001, 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.041 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.042 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.043 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.044 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.045 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.046 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.372467548000003, 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.047 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.048 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.049 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:50.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.052 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.353608039999997, 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.053 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:50.054 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.055 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:50.057 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.058 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.348814015000002, 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:50.060 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.061 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:50.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:50.063 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.064 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:50.065 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.066 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.347509870000003, 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.067 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.068 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.070 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:50.072 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.073 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 44.337557134999997, 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:50.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:50.075 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.076 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:50.077 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:50.078 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:50.079 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:50.080 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:50.081 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:50.082 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:50.082 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:50.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:50.083 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.081+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.083 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:50.084 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:50.084 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:50.084 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:50.182 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:50.181+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:50.186 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.186 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:50.283 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:50.282+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:50.338 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.338 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:50.384 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.384+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.485 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.484+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.489 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.489 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:50.585 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.585+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.605 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:50.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:50.697 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.697+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.755 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:50.805 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:50.804+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:50.888 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:50.887+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:50.906 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:50.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:50.989 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:50.988+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:51.018 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.093 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:51.095 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.094+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.196 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.195+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.238 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.238 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:51.296 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.296+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.320 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-12T21:52:51.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-12T21:52:51.348 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.348 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.357 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:51.397 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:51.396+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:51.471 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.472 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:51.498 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:51.497+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:51.583 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.583 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:51.613 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:51.635 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.634+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.696 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.696 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.699 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.697+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:51.800 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.798+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.807 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.807 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:51.901 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:51.899+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:51.918 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:51.918 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:51.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:52.002 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:52.001+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:52.029 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:52.029 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:52.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:52:52.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-09-12T21:52:52.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T21:52:52.104 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:52.103+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:52.154 INFO:teuthology.orchestra.run.smithi089.stdout:ERROR: (22) Invalid argument 2024-09-12T21:52:52.154 INFO:teuthology.orchestra.run.smithi089.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T21:52:52.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T21:52:52.210 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:52.208+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:52.214 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-09-12T21:52:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T21:52:52.233 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-09-12T21:52:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T21:52:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T21:52:52.236 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T21:52:52.237 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T21:52:52.269 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:52.269 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:52:52.269 INFO:teuthology.orchestra.run.smithi089.stdout: "complaint_time": 30, 2024-09-12T21:52:52.269 INFO:teuthology.orchestra.run.smithi089.stdout: "num_blocked_ops": 0 2024-09-12T21:52:52.270 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:52.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T21:52:52.305 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:52.304+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:52.406 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-12T21:52:52.405+0000 7f2435073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30567) UID: 0 2024-09-12T21:52:52.422 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:52:52.422 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 20, 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 600, 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [ 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66578 5.9 5:9fca79ba:::benchmark_data_smithi053_32461_object66577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.110437851, 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.018701861, 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.423 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66578 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.424 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309831+0000", 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309832+0000", 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.082e-06 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.309944+0000", 2024-09-12T21:52:52.425 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111641 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310021+0000", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6768999999999996e-05 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310030+0000", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3530000000000001e-06 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310078+0000", 2024-09-12T21:52:52.426 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.744e-05 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.310085+0000", 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315636+0000", 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0055502890000001 2024-09-12T21:52:52.427 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.315764+0000", 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00012799099999999999 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328426+0000", 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.01266279 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328465+0000", 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8078999999999999e-05 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328533+0000", 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8756000000000004e-05 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66580 5.9 5:97dea15e:::benchmark_data_smithi053_32461_object66579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.108816456, 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171590589999999, 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.430 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66580 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311453+0000", 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311454+0000", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311522+0000", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8694000000000003e-05 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311529+0000", 2024-09-12T21:52:52.432 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.5200000000000003e-06 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311533+0000", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1150000000000004e-06 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311575+0000", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2354000000000001e-05 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311583+0000", 2024-09-12T21:52:52.433 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8280000000000003e-06 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318140+0000", 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0065567150000001 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318251+0000", 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000111001 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.434 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328541+0000", 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.010289680000000001 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328573+0000", 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2990000000000001e-05 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328612+0000", 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.837e-05 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.435 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66582 5.9 5:9361fe9e:::benchmark_data_smithi053_32461_object66581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.108726426999993, 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0171344980000001, 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.436 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66582 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311543+0000", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.51e-07 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311588+0000", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4827000000000003e-05 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311594+0000", 2024-09-12T21:52:52.438 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3160000000000002e-06 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311598+0000", 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.704e-06 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311644+0000", 2024-09-12T21:52:52.439 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5935e-05 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.311652+0000", 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8590000000000005e-06 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321042+0000", 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0093898640000001 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.440 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321144+0000", 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010181800000000001 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328617+0000", 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.007473838 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328642+0000", 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4581000000000001e-05 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.441 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328677+0000", 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5305000000000002e-05 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66590 5.f 5:f17a49ae:::benchmark_data_smithi053_32461_object66589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.105554725999994, 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0043643840000001, 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.442 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66590 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.443 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314715+0000", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2800000000000005e-07 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314830+0000", 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00011416 2024-09-12T21:52:52.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314841+0000", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.1155000000000001e-05 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314851+0000", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0223e-05 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314895+0000", 2024-09-12T21:52:52.445 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4030999999999999e-05 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.314900+0000", 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1610000000000002e-06 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313790+0000", 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99889022299999997 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.446 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.313934+0000", 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00014315899999999999 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.318962+0000", 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0050281329999999997 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319011+0000", 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9741999999999999e-05 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.447 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.319079+0000", 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.7469000000000001e-05 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66591 5.9 5:9639c536:::benchmark_data_smithi053_32461_object66590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.105034470999996, 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.013526565, 2024-09-12T21:52:52.448 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66591 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.449 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315235+0000", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315236+0000", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.92e-07 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315294+0000", 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8616000000000003e-05 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315304+0000", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5859999999999994e-06 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315310+0000", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9190000000000004e-06 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315345+0000", 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5645999999999997e-05 2024-09-12T21:52:52.451 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.315350+0000", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9019999999999998e-06 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323688+0000", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.008337531 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.323789+0000", 2024-09-12T21:52:52.452 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000100886 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328682+0000", 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0048937379999999999 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328705+0000", 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.2744000000000001e-05 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.453 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.328761+0000", 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6205000000000001e-05 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66600 5.f 5:fd50d1ae:::benchmark_data_smithi053_32461_object66599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.098450984999999, 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99951732999999998, 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.454 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66600 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.455 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321818+0000", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321819+0000", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8599999999999997e-07 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321877+0000", 2024-09-12T21:52:52.456 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.7534999999999997e-05 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321884+0000", 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7020000000000001e-06 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321889+0000", 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.33e-06 2024-09-12T21:52:52.457 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321935+0000", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6604999999999998e-05 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.321943+0000", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9750000000000007e-06 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316316+0000", 2024-09-12T21:52:52.458 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99437303200000005 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.316449+0000", 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013302999999999999 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321209+0000", 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0047602169999999997 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321263+0000", 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.3480000000000003e-05 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.321336+0000", 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2638000000000005e-05 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.460 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:66606 5.9 5:92e00f8a:::benchmark_data_smithi053_32461_object66605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 91.085841173000006, 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99624142599999999, 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 66606 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.461 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334428+0000", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334433+0000", 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2290000000000002e-06 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.462 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334462+0000", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8620999999999999e-05 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334470+0000", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6179999999999997e-06 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334474+0000", 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2919999999999997e-06 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.463 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334523+0000", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9456999999999998e-05 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:21.334530+0000", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2999999999999998e-06 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325255+0000", 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99072497199999998 2024-09-12T21:52:52.464 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.325324+0000", 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.9453000000000001e-05 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330575+0000", 2024-09-12T21:52:52.465 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0052507559999999997 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330617+0000", 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2039000000000002e-05 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.466 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:51:22.330670+0000", 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2689000000000003e-05 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164588 5.a 5:5e480a4a:::benchmark_data_smithi053_32461_object15272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.912595025000002, 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0107525530000001, 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.467 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164588 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.468 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507674+0000", 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507675+0000", 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5000000000000003e-07 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507677+0000", 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.886e-06 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.469 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507682+0000", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5740000000000003e-06 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507686+0000", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8580000000000002e-06 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507767+0000", 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.085e-05 2024-09-12T21:52:52.470 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.507775+0000", 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6709999999999999e-06 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513630+0000", 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.005855285 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.471 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513723+0000", 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.3162e-05 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.513808+0000", 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.4647000000000005e-05 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518290+0000", 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0044823040000000003 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.472 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518343+0000", 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2590000000000003e-05 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518378+0000", 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5221e-05 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.473 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518427+0000", 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8955000000000001e-05 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164591 5.a 5:5a1b4cd5:::benchmark_data_smithi053_32461_object15275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.910044262, 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.011339684, 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.474 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164591 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.475 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510225+0000", 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.476 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510226+0000", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1799999999999995e-07 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510229+0000", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9809999999999999e-06 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510241+0000", 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2417e-05 2024-09-12T21:52:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510248+0000", 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3150000000000003e-06 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.478 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510289+0000", 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0206000000000001e-05 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.510293+0000", 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7319999999999998e-06 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515538+0000", 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0052447819999999 2024-09-12T21:52:52.479 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515617+0000", 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8789999999999996e-05 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.515677+0000", 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.9839000000000001e-05 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.480 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518334+0000", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0026577509999999999 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521451+0000", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031163760000000001 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521492+0000", 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0843999999999997e-05 2024-09-12T21:52:52.481 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521565+0000", 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3033000000000004e-05 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164600 5.a 5:5b977952:::benchmark_data_smithi053_32461_object15284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.907468575000003, 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0088360830000001, 2024-09-12T21:52:52.482 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164600 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.483 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512801+0000", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512802+0000", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2699999999999998e-07 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512806+0000", 2024-09-12T21:52:52.484 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.0230000000000003e-06 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512816+0000", 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0596e-05 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512823+0000", 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3270000000000003e-06 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.485 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512873+0000", 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9583000000000003e-05 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.512881+0000", 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0819999999999999e-06 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.486 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516444+0000", 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.003563191 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516522+0000", 2024-09-12T21:52:52.487 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.7724000000000003e-05 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.516590+0000", 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8071000000000006e-05 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519373+0000", 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027826420000000001 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.488 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521570+0000", 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021972860000000001 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521594+0000", 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4360000000000001e-05 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521637+0000", 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.2370999999999998e-05 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.489 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164610 5.a 5:51edce0e:::benchmark_data_smithi053_32461_object15294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.905281352999999, 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0067537479999999, 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.490 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164610 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.491 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514988+0000", 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.8100000000000003e-07 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514992+0000", 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.0259999999999999e-06 2024-09-12T21:52:52.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.514997+0000", 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0490000000000003e-06 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515000+0000", 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.45e-06 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.493 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515032+0000", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.1680000000000002e-05 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.515037+0000", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517369+0000", 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.00233244 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.494 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517458+0000", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.9097000000000004e-05 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.517533+0000", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5060000000000003e-05 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521392+0000", 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038586359999999999 2024-09-12T21:52:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521642+0000", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00024990899999999998 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521666+0000", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.4304e-05 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521742+0000", 2024-09-12T21:52:52.496 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5625999999999997e-05 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164623 5.a 5:5b15ada2:::benchmark_data_smithi053_32461_object15307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.900192726, 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0042318450000001, 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.497 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164623 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.498 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520077+0000", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9299999999999998e-07 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520080+0000", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.559e-06 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.499 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520087+0000", 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.6079999999999998e-06 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520091+0000", 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.7519999999999998e-06 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520165+0000", 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3904000000000003e-05 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.500 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.520170+0000", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.2610000000000001e-06 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518451+0000", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99828053699999997 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518534+0000", 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3485000000000005e-05 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.501 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.518594+0000", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0269000000000002e-05 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521443+0000", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002848869 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524233+0000", 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002789438 2024-09-12T21:52:52.502 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524259+0000", 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.6463000000000001e-05 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524308+0000", 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9206999999999998e-05 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.503 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164654 5.a 5:567e0369:::benchmark_data_smithi053_32461_object15338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.889019439999998, 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.99320004799999995, 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164654 2024-09-12T21:52:52.504 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.505 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531250+0000", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3000000000000002e-07 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531252+0000", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.75e-06 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531256+0000", 2024-09-12T21:52:52.506 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5900000000000001e-06 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531261+0000", 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.8659999999999997e-06 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531308+0000", 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.6285000000000002e-05 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.507 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.531320+0000", 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2602000000000001e-05 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519465+0000", 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98814476600000001 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.508 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519560+0000", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.4962000000000003e-05 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.519620+0000", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0480999999999999e-05 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524317+0000", 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0046963689999999997 2024-09-12T21:52:52.509 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524356+0000", 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.9190000000000003e-05 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524388+0000", 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.2341000000000001e-05 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.510 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524450+0000", 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.1515999999999999e-05 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164663 5.a 5:57c74182:::benchmark_data_smithi053_32461_object15347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.885226162000002, 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98954234699999999, 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.511 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164663 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:52.512 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535043+0000", 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535044+0000", 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.0399999999999995e-07 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.513 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535047+0000", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.5260000000000002e-06 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535058+0000", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0611000000000001e-05 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535064+0000", 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.6280000000000002e-06 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.514 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535098+0000", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.4211000000000002e-05 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.535103+0000", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7639999999999996e-06 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520417+0000", 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98531448600000004 2024-09-12T21:52:52.515 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520512+0000", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.5081999999999995e-05 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.520586+0000", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.3473999999999995e-05 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524322+0000", 2024-09-12T21:52:52.516 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0037367670000000002 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524492+0000", 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00016993499999999999 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524540+0000", 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7407999999999997e-05 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.517 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524585+0000", 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.5751000000000003e-05 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164681 5.a 5:518c0b1d:::benchmark_data_smithi053_32461_object15365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.877432114999998, 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.98466539799999997, 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.518 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164681 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.519 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542837+0000", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542838+0000", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.2900000000000003e-07 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542841+0000", 2024-09-12T21:52:52.520 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.619e-06 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542849+0000", 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.8299999999999996e-06 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542855+0000", 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.0950000000000001e-06 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.521 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542906+0000", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1054000000000003e-05 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.542912+0000", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0880000000000002e-06 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521779+0000", 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.978867818 2024-09-12T21:52:52.522 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521882+0000", 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000103014 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.521981+0000", 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.8630999999999998e-05 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.523 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524593+0000", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002611712 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527376+0000", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0027829899999999999 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527419+0000", 2024-09-12T21:52:52.524 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.295e-05 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527503+0000", 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3868000000000004e-05 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164757 5.a 5:52043217:::benchmark_data_smithi053_32461_object15441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.525 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.84580536, 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.95324123800000005, 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164757 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.526 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574464+0000", 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574465+0000", 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.5499999999999997e-07 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.527 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574468+0000", 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.472e-06 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574476+0000", 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.1669999999999999e-06 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.528 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574481+0000", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4299999999999999e-06 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574522+0000", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1570999999999999e-05 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.574528+0000", 2024-09-12T21:52:52.529 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.5430000000000001e-06 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523278+0000", 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.94874989600000004 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523361+0000", 2024-09-12T21:52:52.530 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.3374000000000005e-05 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.523443+0000", 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2219999999999995e-05 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527334+0000", 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0038902450000000001 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.531 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527571+0000", 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00023718799999999999 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527622+0000", 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1378000000000002e-05 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527705+0000", 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.2998999999999996e-05 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164796 5.a 5:5fdc6341:::benchmark_data_smithi053_32461_object15480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.826945852000001, 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93554138099999995, 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.533 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164796 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593323+0000", 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.534 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593324+0000", 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.8999999999999996e-07 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593327+0000", 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.3830000000000001e-06 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593334+0000", 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4459999999999998e-06 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.535 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593339+0000", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1440000000000002e-06 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593390+0000", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0977999999999999e-05 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.593399+0000", 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.6859999999999995e-06 2024-09-12T21:52:52.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524618+0000", 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93121889700000005 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524719+0000", 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010147800000000001 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.524811+0000", 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2168000000000003e-05 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527717+0000", 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002905445 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528725+0000", 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0010081129999999999 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.538 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528777+0000", 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1801000000000001e-05 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528865+0000", 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8152000000000006e-05 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164801 5.a 5:56a26b5b:::benchmark_data_smithi053_32461_object15485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.539 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.822151826999999, 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93085696799999995, 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164801 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.540 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598117+0000", 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.541 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.544 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.544 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598118+0000", 2024-09-12T21:52:52.544 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0200000000000001e-07 2024-09-12T21:52:52.544 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.544 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598122+0000", 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.036e-06 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598133+0000", 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0871e-05 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.545 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598138+0000", 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.9649999999999999e-06 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598189+0000", 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.0886e-05 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.598198+0000", 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 9.2410000000000001e-06 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.546 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526004+0000", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92780591199999995 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526142+0000", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00013741200000000001 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.526251+0000", 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000108992 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.547 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528877+0000", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.002626331 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528901+0000", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.3981e-05 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528930+0000", 2024-09-12T21:52:52.548 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.9337000000000001e-05 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.528974+0000", 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4202000000000001e-05 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164806 5.a 5:5a777da3:::benchmark_data_smithi053_32461_object15490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:52.549 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.820847682, 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.93289590099999997, 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164806 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:52.550 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599422+0000", 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.551 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599427+0000", 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.1659999999999996e-06 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599442+0000", 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.5780000000000001e-05 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599449+0000", 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.3810000000000004e-06 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.552 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599491+0000", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.193e-05 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.599495+0000", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.3320000000000002e-06 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527736+0000", 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92824110100000001 2024-09-12T21:52:52.553 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527817+0000", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.0797000000000006e-05 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.527879+0000", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.2341000000000005e-05 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.530137+0000", 2024-09-12T21:52:52.554 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0022579280000000002 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532242+0000", 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0021050969999999998 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532270+0000", 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.8024000000000001e-05 2024-09-12T21:52:52.555 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532317+0000", 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7233e-05 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "description": "osd_op(client.4635.0:164824 5.a 5:567ba867:::benchmark_data_smithi053_32461_object15508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "initiated_at": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:52.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 46.810894947000001, 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.92313743000000004, 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "continuous": false, 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "type_data": { 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_info": { 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client": "client.4635", 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "tid": 164824 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "events": [ 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "initiated", 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "header_read", 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609374+0000", 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "throttled", 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609375+0000", 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.7700000000000005e-07 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "all_read", 2024-09-12T21:52:52.558 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609377+0000", 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 2.441e-06 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "dispatched", 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609384+0000", 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 6.4180000000000002e-06 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609389+0000", 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 5.1850000000000003e-06 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609427+0000", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 3.8383000000000002e-05 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:05.609438+0000", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.0835999999999999e-05 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "reached_pg", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529016+0000", 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.91957841500000004 2024-09-12T21:52:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "started", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529136+0000", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.000119252 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "waiting for subops from 1", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.529237+0000", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.00010085399999999999 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532367+0000", 2024-09-12T21:52:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 0.0031304060000000001 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "op_commit", 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532379+0000", 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 1.2045000000000001e-05 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "commit_sent", 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532423+0000", 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 4.4357000000000002e-05 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "event": "done", 2024-09-12T21:52:52.562 INFO:teuthology.orchestra.run.smithi089.stdout: "time": "2024-09-12T21:52:06.532512+0000", 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: "duration": 8.8361000000000003e-05 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-12T21:52:52.563 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:52:52.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T21:52:52.565 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:52:52.563+0000 7efebe5dd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30591) UID: 0 2024-09-12T21:52:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'unique_pool_0' removed 2024-09-12T21:52:52.628 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T21:52:52.638 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T21:52:52.697 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:52.698 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:52.698 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-12T21:52:52.698 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:52.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T21:52:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-12T21:52:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-12T21:52:52.815 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-12T21:52:52.815 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:52.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T21:52:52.931 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44648 5.5 5:a02284b4:::benchmark_data_smithi053_32461_object44647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 100.589586152, 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066514904, 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44648 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339725+0000", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339727+0000", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3239999999999999e-06 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339825+0000", 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8488999999999998e-05 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339836+0000", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1011e-05 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339844+0000", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339890+0000", 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6378000000000002e-05 2024-09-12T21:52:52.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.339976+0000", 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5478999999999999e-05 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.340051+0000", 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5327999999999994e-05 2024-09-12T21:52:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343246+0000", 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031955059999999999 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406179+0000", 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062932291000000001 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406209+0000", 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0394000000000001e-05 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406240+0000", 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1319999999999998e-05 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44649 5.5 5:acab4573:::benchmark_data_smithi053_32461_object44648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 100.588264626, 2024-09-12T21:52:52.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065753011, 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44649 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:52.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341047+0000", 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341048+0000", 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9100000000000003e-07 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341102+0000", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3993999999999998e-05 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341111+0000", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8470000000000002e-06 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341115+0000", 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8289999999999998e-06 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341839+0000", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000723853 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341947+0000", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107469 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342076+0000", 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012947999999999999 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347320+0000", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052436369999999998 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406711+0000", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059391317999999999 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406761+0000", 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9521000000000002e-05 2024-09-12T21:52:52.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406800+0000", 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9271999999999999e-05 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44651 5.5 5:a4915316:::benchmark_data_smithi053_32461_object44650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 100.587776783, 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065416316000000002, 2024-09-12T21:52:52.944 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44651 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341535+0000", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.13e-07 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341603+0000", 2024-09-12T21:52:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7287999999999997e-05 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341609+0000", 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.341612+0000", 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3160000000000001e-06 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343271+0000", 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001659057 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343351+0000", 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9746000000000005e-05 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.343430+0000", 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8936000000000005e-05 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347658+0000", 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042288109999999999 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406861+0000", 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059202754000000003 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406912+0000", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0343999999999998e-05 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406951+0000", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9589999999999999e-05 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:44653 5.3 5:cd016b84:::benchmark_data_smithi053_32461_object44652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 100.58704940200001, 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063992715000000006, 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44653 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342262+0000", 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342263+0000", 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342308+0000", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4910000000000002e-05 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342320+0000", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2274e-05 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342329+0000", 2024-09-12T21:52:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342369+0000", 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0497000000000002e-05 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342456+0000", 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7027000000000006e-05 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.342536+0000", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9567999999999994e-05 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.347648+0000", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051125019999999997 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406154+0000", 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058505750000000002 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406208+0000", 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4253999999999999e-05 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:12.406255+0000", 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6780999999999998e-05 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66569 5.e 5:7674c3bf:::benchmark_data_smithi053_32461_object66568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.620205350999996, 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0057048719999999, 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66569 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309106+0000", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309107+0000", 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.079e-06 2024-09-12T21:52:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309206+0000", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8618999999999999e-05 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309214+0000", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309221+0000", 2024-09-12T21:52:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5729999999999996e-06 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309619+0000", 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039823300000000001 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309638+0000", 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8899999999999999e-05 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313418+0000", 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0037794449999999 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314811+0000", 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013935569999999999 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66570 5.8 5:1c35696e:::benchmark_data_smithi053_32461_object66569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.620077891999998, 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0045704950000001, 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66570 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309234+0000", 2024-09-12T21:52:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2699999999999999e-07 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309267+0000", 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3098000000000001e-05 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309275+0000", 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309280+0000", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310417+0000", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011368509999999999 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310424+0000", 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312242+0000", 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001817631 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.313804+0000", 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015621579999999999 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66577 5.4 5:2154ba1d:::benchmark_data_smithi053_32461_object66576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.620019271999993, 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0148016280000001, 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66577 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309292+0000", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309293+0000", 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2399999999999998e-07 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309319+0000", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.569e-05 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309326+0000", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.309332+0000", 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3679999999999998e-06 2024-09-12T21:52:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310366+0000", 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010339380000000001 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.310375+0000", 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315958+0000", 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.005583731 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.317534+0000", 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001575398 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324014+0000", 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064800500000000002 2024-09-12T21:52:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324049+0000", 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5145999999999999e-05 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.324094+0000", 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5142000000000002e-05 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66581 5.a 5:518cea3d:::benchmark_data_smithi053_32461_object66580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.617907626000004, 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0067721860000001, 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66581 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311404+0000", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311405+0000", 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0299999999999998e-07 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311507+0000", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010189899999999999 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311514+0000", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7319999999999998e-06 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311520+0000", 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4779999999999999e-06 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311560+0000", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913999999999998e-05 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.311566+0000", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312369+0000", 2024-09-12T21:52:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0008022780000001 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.312512+0000", 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142977 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318041+0000", 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055298450000000002 2024-09-12T21:52:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318101+0000", 2024-09-12T21:52:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9518999999999997e-05 2024-09-12T21:52:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.318176+0000", 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5315000000000007e-05 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66587 5.8 5:1689a349:::benchmark_data_smithi053_32461_object66586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.616250683999993, 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0082884780000001, 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66587 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313061+0000", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313062+0000", 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6799999999999999e-07 2024-09-12T21:52:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313127+0000", 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5321999999999996e-05 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313139+0000", 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2074e-05 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313145+0000", 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313188+0000", 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2846000000000003e-05 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.313193+0000", 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314103+0000", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009102059999999 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.314583+0000", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047947499999999999 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321226+0000", 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066430830000000001 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321281+0000", 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4892999999999998e-05 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321349+0000", 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66588 5.e 5:7cc01600:::benchmark_data_smithi053_32461_object66587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.615301084999999, 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.013831991, 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66588 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314011+0000", 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999999e-07 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314107+0000", 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5431000000000002e-05 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314114+0000", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5580000000000003e-06 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314120+0000", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7989999999999999e-06 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314155+0000", 2024-09-12T21:52:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5154000000000003e-05 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.314163+0000", 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5490000000000001e-06 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315151+0000", 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0009886480000001 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315630+0000", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047893499999999999 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327698+0000", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012067293999999999 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327753+0000", 2024-09-12T21:52:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5642e-05 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.327843+0000", 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9322999999999998e-05 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66596 5.a 5:58a415f5:::benchmark_data_smithi053_32461_object66595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.611076998000001, 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.000928756, 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66596 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318235+0000", 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0599999999999999e-07 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318279+0000", 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3875000000000003e-05 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318296+0000", 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6282000000000001e-05 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318322+0000", 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6236000000000001e-05 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318366+0000", 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4517000000000001e-05 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.318374+0000", 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315211+0000", 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99683723000000002 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.315359+0000", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775000000000001 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319042+0000", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036834900000000002 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319095+0000", 2024-09-12T21:52:53.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2864000000000001e-05 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.319163+0000", 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8133999999999995e-05 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66598 5.e 5:7bb469ba:::benchmark_data_smithi053_32461_object66597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.608723459999993, 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007689595, 2024-09-12T21:52:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66598 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320588+0000", 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320589+0000", 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7999999999999995e-07 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320648+0000", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9519999999999999e-05 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320657+0000", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7620000000000001e-06 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320661+0000", 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.98e-06 2024-09-12T21:52:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320699+0000", 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7521999999999998e-05 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.320704+0000", 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8899999999999998e-06 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323115+0000", 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0024109999999999 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.323253+0000", 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013820600000000001 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328146+0000", 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048932799999999999 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328199+0000", 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2627000000000003e-05 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328278+0000", 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9128000000000005e-05 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:66601 5.0 5:013154c5:::benchmark_data_smithi053_32461_object66600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.607100267999996, 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.006175217, 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66601 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322211+0000", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322212+0000", 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5599999999999995e-07 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322272+0000", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0140999999999999e-05 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322283+0000", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1348999999999999e-05 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322288+0000", 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9590000000000003e-06 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322362+0000", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3986999999999995e-05 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:21.322367+0000", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.321390+0000", 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.999022254 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.322753+0000", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013633510000000001 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328265+0000", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005512388 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328315+0000", 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9672999999999997e-05 2024-09-12T21:52:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:51:22.328387+0000", 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1466999999999999e-05 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177825 5.3 5:c57ed224:::benchmark_data_smithi053_32461_object28509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.247754248, 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.068514822000000003, 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177825 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681557+0000", 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681558+0000", 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5999999999999991e-07 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681563+0000", 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3730000000000003e-06 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681572+0000", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6949999999999995e-06 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.681580+0000", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5410000000000003e-06 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683573+0000", 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019930149999999999 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683673+0000", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100194 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683772+0000", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8401999999999997e-05 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685502+0000", 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303889999999999 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.749992+0000", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064490288000000007 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750038+0000", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5691e-05 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750072+0000", 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4273999999999997e-05 2024-09-12T21:52:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177830 5.2 5:492089ec:::benchmark_data_smithi053_32461_object28514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.246037459, 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066885206000000003, 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177830 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683274+0000", 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683275+0000", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8299999999999995e-07 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683279+0000", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0640000000000004e-06 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683288+0000", 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0739999999999999e-06 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683295+0000", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.683963+0000", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066851400000000004 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684086+0000", 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012252899999999999 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684230+0000", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014406999999999999 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.687794+0000", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003564209 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750041+0000", 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247380999999997 2024-09-12T21:52:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750102+0000", 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0832999999999998e-05 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750159+0000", 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7065999999999999e-05 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177833 5.2 5:4f1bf995:::benchmark_data_smithi053_32461_object28517:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.245298652000002, 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.067220265000000001, 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177833 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684013+0000", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684014+0000", 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9599999999999998e-07 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684018+0000", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684028+0000", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7690000000000008e-06 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684035+0000", 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5479999999999998e-06 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.685901+0000", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018662259999999999 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686035+0000", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133967 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686169+0000", 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134513 2024-09-12T21:52:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688069+0000", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00189981 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751113+0000", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063044250999999996 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751148+0000", 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5080000000000003e-05 2024-09-12T21:52:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.751233+0000", 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4794000000000002e-05 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177835 5.5 5:ada49324:::benchmark_data_smithi053_32461_object28519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.245262943, 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066073320000000005, 2024-09-12T21:52:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177835 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684049+0000", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4799999999999999e-07 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684051+0000", 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684059+0000", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1500000000000002e-06 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684063+0000", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684107+0000", 2024-09-12T21:52:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3611e-05 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684212+0000", 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105016 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.684309+0000", 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6753e-05 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.686281+0000", 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019719020000000002 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750028+0000", 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063747596000000004 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750083+0000", 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4517e-05 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.750122+0000", 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.913e-05 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177842 5.c 5:3c140a81:::benchmark_data_smithi053_32461_object28526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.240964837, 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359083999999998, 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177842 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688347+0000", 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688348+0000", 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.328e-06 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688354+0000", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688368+0000", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4212999999999999e-05 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688377+0000", 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6219999999999998e-06 2024-09-12T21:52:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688425+0000", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7688999999999997e-05 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688497+0000", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2342000000000006e-05 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.688581+0000", 2024-09-12T21:52:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3719000000000003e-05 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.690139+0000", 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00155799 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753606+0000", 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063467485000000004 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753661+0000", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4258999999999997e-05 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.753706+0000", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5361000000000002e-05 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177846 5.2 5:4432501d:::benchmark_data_smithi053_32461_object28530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.237085112000003, 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062468177, 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177846 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692227+0000", 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8999999999999996e-07 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692230+0000", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9519999999999999e-06 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692239+0000", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5529999999999993e-06 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692245+0000", 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-09-12T21:52:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692282+0000", 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692351+0000", 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9164000000000004e-05 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.692414+0000", 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3145000000000006e-05 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.693990+0000", 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015758899999999999 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754566+0000", 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060575497999999998 2024-09-12T21:52:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754617+0000", 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1048999999999999e-05 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.754695+0000", 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7856999999999997e-05 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4635.0:177850 5.3 5:cb3721ec:::benchmark_data_smithi053_32461_object28534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.234834689000003, 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062372654, 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4635", 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.53:0/1341230417", 2024-09-12T21:52:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 177850 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694477+0000", 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694478+0000", 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2699999999999999e-06 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694483+0000", 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1340000000000003e-06 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694498+0000", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4211e-05 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694507+0000", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1190000000000003e-06 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694545+0000", 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8359000000000003e-05 2024-09-12T21:52:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694624+0000", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.694688+0000", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4035999999999995e-05 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.695973+0000", 2024-09-12T21:52:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001284791 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756799+0000", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060826083000000003 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756828+0000", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907999999999998e-05 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-12T21:52:10.756850+0000", 2024-09-12T21:52:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1965999999999999e-05 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-12T21:52:53.055 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-12T21:52:53.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T21:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-09-12T21:52:54.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T21:52:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-09-12T21:52:57.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-09-12T21:53:03.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-09-12T21:53:09.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-09-12T21:53:15.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-09-12T21:53:21.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-09-12T21:53:26.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-09-12T21:53:32.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-09-12T21:53:38.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-09-12T21:53:44.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-09-12T21:53:45.324 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7F 91 GUID: 00000000 0000 0000 0000 0CC47AD9172C DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7f:91)... Configuring (net0 0c:c4:7a:88:7f:91).... Configuring (net0 0c:c4:7a:88:7f:91)..... Configuring (net0 0c:c4:7a:88:7f:91)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              CentOS Stream (5.14.0-503.el9.x86_64) 9  The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.080 MHz processor [ 0.000410] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000414] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000745] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006405] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006414] Using GB pages for direct mapping [ 0.006566] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006568] ACPI: Early table checksum verification disabled [ 0.006571] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006574] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006578] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006582] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006585] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006586] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006589] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006591] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006593] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006595] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006598] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006600] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006602] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006604] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006606] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006609] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006611] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006613] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006615] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006618] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006620] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006622] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006624] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006626] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006627] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006628] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006628] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006629] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006630] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006630] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006631] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006631] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006632] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006633] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006633] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006634] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006634] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006635] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006635] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006636] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006637] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006637] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006638] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006638] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006685] No NUMA configuration found [ 0.006686] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006694] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006866] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006902] Zone ranges: [ 0.006902] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006904] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006905] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006906] Device empty [ 0.006907] Movable zone start for each node [ 0.006909] Early memory node ranges [ 0.006909] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006910] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006911] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006915] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006919] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006955] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011813] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011925] ACPI: PM-Timer IO Port: 0x408 [ 0.011934] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011935] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011936] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011936] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011937] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011938] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011938] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011939] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011948] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011952] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011954] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011955] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011959] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011960] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011964] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011969] CPU topo: Max. logical packages: 1 [ 0.011970] CPU topo: Max. logical dies: 1 [ 0.011970] CPU topo: Max. dies per package: 1 [ 0.011974] CPU topo: Max. threads per core: 2 [ 0.011975] CPU topo: Num. cores per package: 4 [ 0.011976] CPU topo: Num. threads per package: 8 [ 0.011976] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011985] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011986] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011987] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011988] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011989] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011989] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011990] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011990] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011991] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011993] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011994] Booting paravirtualized kernel on bare hardware [ 0.011997] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016392] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016613] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016635] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016688] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016703] random: crng init done [ 0.018886] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020029] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020134] Fallback order for Node 0: 0 [ 0.020137] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020138] Policy zone: Normal [ 0.020280] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020289] software IO TLB: area num 8. [ 0.041894] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989836K reserved, 0K cma-reserved) [ 0.041996] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.042004] Kernel/User page tables isolation: enabled [ 0.042028] ftrace: allocating 48134 entries in 189 pages [ 0.048938] ftrace: allocated 189 pages with 6 groups [ 0.049467] Dynamic Preempt: voluntary [ 0.049509] rcu: Preemptible hierarchical RCU implementation. [ 0.049510] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.049511] Trampoline variant of Tasks RCU enabled. [ 0.049511] Rude variant of Tasks RCU enabled. [ 0.049512] Tracing variant of Tasks RCU enabled. [ 0.049513] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.049513] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052986] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.053148] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.053257] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.058520] Console: colour VGA+ 80x25 [ 0.058537] printk: console [ttyS1] enabled [ 1.128988] ACPI: Core revision 20230331 [ 1.133081] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.142208] APIC: Switch to symmetric I/O mode setup [ 1.147179] DMAR: Host address width 46 [ 1.151022] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.156338] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.164332] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.170598] DMAR: ATSR flags: 0x0 [ 1.173918] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.180183] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.186536] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192888] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.198287] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.198288] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.213318] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.218622] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.224834] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.235206] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32739cab026, max_idle_ns: 440795371541 ns [ 1.245717] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.16 BogoMIPS (lpj=3500080) [ 1.246735] CPU0: Thermal monitoring enabled (TM1) [ 1.247772] process: using mwait in idle threads [ 1.248717] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.249716] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.250717] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.251717] Spectre V2 : Mitigation: Retpolines [ 1.253716] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.254716] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.255716] Speculative Store Bypass: Vulnerable [ 1.256721] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257716] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.258716] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.259719] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.260716] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.261716] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.262716] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.263716] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.276385] Freeing SMP alternatives memory: 40K [ 1.276716] pid_max: default: 32768 minimum: 301 [ 1.277735] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.278720] Yama: becoming mindful. [ 1.279722] SELinux: Initializing. [ 1.280732] LSM support for eBPF active [ 1.281775] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.282754] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.386808] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.388820] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.389728] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.390725] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.391724] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.392717] ... version: 3 [ 1.393716] ... bit width: 48 [ 1.394716] ... generic registers: 4 [ 1.395716] ... value mask: 0000ffffffffffff [ 1.396716] ... max period: 00007fffffffffff [ 1.397716] ... fixed-purpose events: 3 [ 1.398716] ... event mask: 000000070000000f [ 1.399799] signal: max sigframe size: 1776 [ 1.400727] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.401742] rcu: Hierarchical SRCU implementation. [ 1.401743] rcu: Max phase no-delay instances is 400. [ 1.405188] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.405784] smp: Bringing up secondary CPUs ... [ 1.406782] smpboot: x86: Booting SMP configuration: [ 1.406783] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.409975] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.409975] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.409975] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.414745] smp: Brought up 1 node, 8 CPUs [ 1.414745] smpboot: Total of 8 processors activated (56001.28 BogoMIPS) [ 1.458576] node 0 deferred pages initialised in 40ms [ 1.460744] devtmpfs: initialized [ 1.460746] x86/mm: Memory block size: 128MB [ 1.461715] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.461715] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.461715] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.461715] pinctrl core: initialized pinctrl subsystem [ 1.466715] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.466717] audit: initializing netlink subsys (disabled) [ 1.466725] audit: type=2000 audit(1726177996.241:1): state=initialized audit_enabled=0 res=1 [ 1.466785] thermal_sys: Registered thermal governor 'fair_share' [ 1.466786] thermal_sys: Registered thermal governor 'step_wise' [ 1.466786] thermal_sys: Registered thermal governor 'user_space' [ 1.467718] cpuidle: using governor menu [ 1.468735] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.468736] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.468793] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.468803] PCI: Using configuration type 1 for base access [ 1.472744] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.472749] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.472749] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.472749] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.472749] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.473744] cryptd: max_cpu_qlen set to 1000 [ 1.473783] ACPI: Added _OSI(Module Device) [ 1.473784] ACPI: Added _OSI(Processor Device) [ 1.473785] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.473786] ACPI: Added _OSI(Processor Aggregator Device) [ 1.473786] ACPI: Added _OSI(Linux-Dell-Video) [ 1.473788] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.473789] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.478306] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.478715] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.478715] ACPI: Dynamic OEM Table Load: [ 1.496997] ACPI: _OSC evaluated successfully for all CPUs [ 1.497261] ACPI: Interpreter enabled [ 1.497271] ACPI: PM: (supports S0 S4 S5) [ 1.497271] ACPI: Using IOAPIC for interrupt routing [ 1.498769] HEST: Enabling Firmware First mode for corrected errors. [ 1.529301] HEST: Table parsing has been initialized. [ 1.529418] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.529420] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.529420] PCI: Using E820 reservations for host bridge windows [ 1.529861] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.550803] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.550808] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.551930] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.552465] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.552466] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.552494] PCI host bridge to bus 0000:ff [ 1.552495] pci_bus 0000:ff: root bus resource [bus ff] [ 1.552506] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.552549] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.552580] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.552610] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.552642] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.552672] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.552700] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.552732] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.552762] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.552791] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.552821] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.552850] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.552880] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.552910] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.552939] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.552971] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.552999] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.553028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.553059] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.553082] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.553118] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553179] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553238] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553305] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553364] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553424] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553465] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.553496] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.553530] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553573] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553615] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553657] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553697] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.553731] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.553762] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.553793] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.553826] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553868] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553910] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553952] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553996] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.554031] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.554063] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.554095] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.554129] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.554160] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.554191] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.554222] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.554256] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.554286] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.554317] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.554348] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.554371] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.554402] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.554433] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.556678] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.556681] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.556816] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.557059] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.557060] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.557472] PCI host bridge to bus 0000:00 [ 1.557474] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.557475] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.557476] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.557477] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.557478] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.557479] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.557480] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.557499] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.557603] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.557615] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.557652] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.557747] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.557759] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.557762] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.557796] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.557886] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.557898] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.557900] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.557901] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.557906] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.557936] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.558022] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558029] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.558109] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558117] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.558195] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558202] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.558276] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558284] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.558361] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558368] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.558443] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558450] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.558524] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558531] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.558607] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558615] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.558688] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558752] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558837] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558894] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.558900] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.558981] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.559222] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.559241] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.559253] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.559264] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.559275] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.559286] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.559297] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.559355] pci 0000:00:11.4: PME# supported from D3hot [ 1.559434] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.559458] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.559544] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.559635] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.559660] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.559748] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.559815] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.559840] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.559927] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.560013] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.560034] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.560147] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.560230] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.560268] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.560360] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.560460] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.560496] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.560501] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.560504] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.560592] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.560696] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.560733] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.560738] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.560742] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.560830] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.560937] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.560959] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.561073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.561153] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.561356] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.561373] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.561385] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.561395] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.561406] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.561416] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.561427] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.561480] pci 0000:00:1f.2: PME# supported from D3hot [ 1.561542] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.561566] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.561595] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.561759] acpiphp: Slot [1] registered [ 1.561770] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.561875] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.561884] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.561900] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.561904] pci 0000:02:00.0: enabling Extended Tags [ 1.562009] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.562116] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.562127] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.562131] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.562141]m 0xfbe04000-0xf] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.562183] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.562200] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562201] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.562209] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562210] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.562364] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.562375] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.562379] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.562389] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.562394] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.562431] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.562445] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562446] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.56 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562456[mem 0x00000000-AR 3 for 64 VFs [ 1.562595] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.562641] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.562734] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.562806] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.562819] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.562824] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.562878] pci 0000:05:00.0: enabling Extended Tags [ 1.563015] pci 0000:05:00.0: supports D1 D2 [ 1.563016] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.563199] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.563287] pci_bus 0000:06: extended config space not accessible [ 1.563322] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.563359] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.563379] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.563399] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.563498] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.563568] pci 0000:06:00.0: supports D1 D2 [ 1.563569] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.563721] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.563867] pc] type 00 class 0x020000 PCIe Endpoint [ 1.563900] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.563937] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.563952] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.564187] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.564247] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564248] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.564282] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564283] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.564626] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.564660] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.5646:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.564716] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.564941] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.564998] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564999] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.565032] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.565033] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.565337] pci 0000:00:1ce to [bus 07] [ 1.565348] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.566013] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.566045] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.566074] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.566104] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.566134] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.566135] ACPI: PCI: Interrupt link LNKE disabled [ 1.566164] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.566165] ACPI: PCI: Interrupt link LNKF disabled [ 1.566195] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.566195] ACPI: PCI: Interrupt link LNKG disabled [ 1.566225] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.566225] ACPI: PCI: Interrupt link LNKH disabled [ 1.566733] iommu: Default domain type: Translated [ 1.566733] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.566784] SCSI subsystem initialized [ 1.566801] ACPI: bus type USB registered [ 1.566814] usbcore: registered new interface driver usbfs [ 1.566819] usbcore: registered new interface driver hub [ 1.566824] usbcore: registered new device driver usb [ 1.566843] pps_core: LinuxPPS API ver. 1 registered [ 1.566844] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.566846] PTP clock support registered [ 1.566859] EDAC MC: Ver: 3.0.0 [ 1.566873] NetLabel: Initializing [ 1.566874] NetLabel: domain hash size = 128 [ 1.566875] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.566887] NetLabel: unlabeled traffic allowed by default [ 1.566888] PCI: Using ACPI for IRQ routing [ 1.577736] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.577738] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.577739] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.577740] vgaarb: loaded [ 1.577747] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.577751] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.585282] clocksource: Switched to clocksource tsc-early [ 1.593828] VFS: Disk quotas dquot_6.6.0 [ 1.593842] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.593909] pnp: PnP ACPI init [ 1.594229] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.594232] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.594233] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.594234] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.594235] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.594236] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.594237] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.594238] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.594239] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.594240] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.594241] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.594242] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.594243] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.594388] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.594389] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.594390] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.594391] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.594392] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.595059] pnp: PnP ACPI: found 5 devices [ 1.600520] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.600569] NET: Registered PF_INET protocol family [ 1.600734] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.602991] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.603023] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.603033] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.603264] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.603380] TCP: Hash tables configured (established 262144 bind 65536) [ 1.603505] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.603597] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.603655] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.603741] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.603745] NET: Registered PF_XDP protocol family [ 1.603768] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.603778] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.603781] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.603786] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.603788] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.603794] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603795] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603797] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603797] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603799] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603800] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603801] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603802] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603803] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603804] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603805] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603806] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603807] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603808] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603810] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603810] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603812] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.603813] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.603815] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.603816] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.603820] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.603833] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.603837] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.603845] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.603860] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.603862] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.603867] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.603877] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.603885] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.603891] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.603897] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.603903] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.603905] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.603910] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.603914] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.603921] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.603922] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.603923] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.603924] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.603925] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.603925] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.603926] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.603927] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.603928] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.603929] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.603930] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.603931] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.603932] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.603933] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.603933] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.603934] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.603935] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.603936] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.604098] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.620584] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15929 usecs [ 1.636581] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15607 usecs [ 1.636594] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.636629] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.636629] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.636636] ACPI: bus type thunderbolt registered [ 1.636654] Trying to unpack rootfs image as initramfs... [ 1.785815] Initialise system trusted keyrings [ 1.785826] Key type blacklist registered [ 1.785873] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.785886] zbud: loaded [ 1.900137] integrity: Platform Keyring initialized [ 1.900144] integrity: Machine keyring initialized [ 1.907882] NET: Registered PF_ALG protocol family [ 1.907884] xor: automatically using best checksumming function avx [ 1.907886] Key type asymmetric registered [ 1.907887] Asymmetric key parser 'x509' registered [ 1.907888] Running certificate verification selftests [ 1.909698] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.910302] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.910330] io scheduler mq-deadline registered [ 1.910331] io scheduler kyber registered [ 1.910338] io scheduler bfq registered [ 1.944480] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.944820] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.944979] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.945124] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.945258] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.945412] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.945565] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.945721] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.945938] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.956188] Freeing initrd memory: 31720K [ 1.970733] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.970757] ACPI: button: Power Button [PWRB] [ 1.970779] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.970846] ACPI: button: Power Button [PWRF] [ 1.989799] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.989801] pstore: Registered erst as persistent store backend [ 1.989908] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.990011] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.998272] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.006927] Non-volatile memory driver v1.3 [ 2.064631] rdac: device handler registered [ 2.064656] hp_sw: device handler registered [ 2.064657] emc: device handler registered [ 2.064675] alua: device handler registered [ 2.064949] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.064991] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.065004] ehci-pci 0000:00:1a.0: debug port 2 [ 2.068937] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.075572] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.075608] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.075610] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.075611] usb usb1: Product: EHCI Host Controller [ 2.075612] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.075613] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.075703] hub 1-0:1.0: USB hub found [ 2.075707] hub 1-0:1.0: 2 ports detected [ 2.075817] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.075852] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.076935] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.077181] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.077183] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.077203] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.077205] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.077245] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 2.077258] ehci-pci 0000:00:1d.0: debug port 2 [ 2.077278] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.077281] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.077283] usb usb2: Product: xHCI Host Controller [ 2.077283] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.077284] usb usb2: SerialNumber: 0000:00:14.0 [ 2.077384] hub 2-0:1.0: USB hub found [ 2.077420] hub 2-0:1.0: 15 ports detected [ 2.079984] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.079986] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.079987] usb usb3: Product: xHCI Host Controller [ 2.079987] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.079988] usb usb3: SerialNumber: 0000:00:14.0 [ 2.080054] hub 3-0:1.0: USB hub found [ 2.080070] hub 3-0:1.0: 6 ports detected [ 2.081018] usbcore: registered new interface driver usbserial_generic [ 2.081022] usbserial: USB Serial support registered for generic [ 2.081049] i8042: PNP: No PS/2 controller found. [ 2.081075] mousedev: PS/2 mouse device common for all mice [ 2.081131] rtc_cmos 00:00: RTC can wake from S4 [ 2.081170] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.081412] rtc_cmos 00:00: registered as rtc0 [ 2.081457] rtc_cmos 00:00: setting system clock to 2024-09-12T21:53:18 UTC (1726177998) [ 2.081479] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.087571] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.087601] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.087603] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.087604] usb usb4: Product: EHCI Host Controller [ 2.087605] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.087605] usb usb4: SerialNumber: 0000:00:1d.0 [ 2.087682] hub 4-0:1.0: USB hub found [ 2.087685] hub 4-0:1.0: 2 ports detected [ 2.097440] intel_pstate: Intel P-state driver initializing [ 2.153894] hid: raw HID events driver (C) Jiri Kosina [ 2.153923] usbcore: registered new interface driver usbhid [ 2.153924] usbhid: USB HID core driver [ 2.153951] drop_monitor: Initializing network drop monitor service [ 2.163332] Initializing XFRM netlink socket [ 2.163352] NET: Registered PF_INET6 protocol family [ 2.168169] Segment Routing with IPv6 [ 2.168186] NET: Registered PF_PACKET protocol family [ 2.168210] mpls_gso: MPLS GSO support [ 2.234194] microcode: Current revision: 0x0b00001b [ 2.247560] resctrl: L3 allocation detected [ 2.247561] resctrl: L3 monitoring detected [ 2.247573] IPI shorthand broadcast: enabled [ 2.247578] AVX2 version of gcm_enc/dec engaged. [ 2.304301] AES CTR mode by8 optimization enabled [ 2.304345] sched_clock: Marking stable (1131000670, 1172538943)->(2841537163, -537997550) [ 2.315577] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.320135] registered taskstats version 1 [ 2.323543] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.331551] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.345315] Loading compiled-in X.509 certificates [ 2.345803] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.346083] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.346356] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.346498] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.346507] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.348248] page_owner is disabled [ 2.348464] pstore: Using crash dump compression: deflate [ 2.348475] Key type big_key registered [ 2.441715] Key type encrypted registered [ 2.441722] ima: No TPM chip found, activating TPM-bypass! [ 2.441725] Loading compiled-in module X.509 certificates [ 2.442012] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.442015] ima: Allocated hash algorithm: sha256 [ 2.442024] ima: No architecture policies found [ 2.442035] evm: Initialising EVM extended attributes: [ 2.442036] evm: security.selinux [ 2.442036] evm: security.SMACK64 (disabled) [ 2.442037] evm: security.SMACK64EXEC (disabled) [ 2.442037] evm: security.SMACK64TRANSMUTE (disabled) [ 2.442038] evm: security.SMACK64MMAP (disabled) [ 2.442038] evm: security.apparmor (disabled) [ 2.442038] evm: security.ima [ 2.442039] evm: security.capability [ 2.442039] evm: HMAC attrs: 0x1 [ 2.456845] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.456847] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.457127] hub 4-1:1.0: USB hub found [ 2.457220] hub 4-1:1.0: 8 ports detected [ 2.463847] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.463850] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.464010] hub 1-1:1.0: USB hub found [ 2.464095] hub 1-1:1.0: 6 ports detected [ 2.501568] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.501572] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.523307] hub 2-12:1.0: USB hub found [ 2.528437] hub 2-12:1.0: 4 ports detected [ 2.665569] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 2.665573] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 2.668057] clocksource: Switched to clocksource tsc [ 2.947546] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.098548] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.098551] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.156894] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.208672] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.218644] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.218731] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.145837] clk: Disabling unused clocks [ 5.150654] Freeing unused decrypted memory: 2028K [ 5.155922] Freeing unused kernel image (initmem) memory: 3980K [ 5.161832] Write protecting the kernel read-only data: 30720k [ 5.167938] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.212482] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.212484] x86/mm: Checking user space page tables [ 5.249129] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.249138] Run /init as init process [ 5.259330] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.259433] systemd[1]: Detected architecture x86-64. [ 5.259435] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.309683] systemd[1]: Hostname set to . [ 5.367591] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.367709] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.389705] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.403611] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.415686] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.426637] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.438663] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.453798] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.467675] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.479729] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.493709] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.507628] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.526257] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.541636] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.554281] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.567192] systemd[1]: Starting Create System Users... Starting Creat[ 5.573888] fuse: init (API version 7.36) e System Users... [ 5.583205] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.596310] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show [ 5.973473] dca service started, version 1.12.1 Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.023469] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.023477] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.024815] nvme nvme0: pci function 0000:02:00.0 [ 6.029919] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.029923] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.029925] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.039159] nvme nvme0: 8/0/0 default/read/poll queues [ 6.051328] scsi host0: ahci [ 6.051561] scsi host1: ahci [ 6.052054] scsi host2: ahci [ 6.052421] scsi host3: ahci [ 6.052469] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 51 lpm-pol 0 [ 6.052472] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 51 lpm-pol 0 [ 6.052474] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 51 lpm-pol 0 [ 6.052476] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 51 lpm-pol 0 [ 6.052775] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.052779] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.052781] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.068005] scsi host4: ahci [ 6.068120] scsi host5: ahci [ 6.068228] scsi host6: ahci [ 6.068336] scsi host7: ahci [ 6.068447] scsi host8: ahci [ 6.068556] scsi host9: ahci [ 6.068604] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 60 lpm-pol 0 [ 6.068608] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 60 lpm-pol 0 [ 6.068611] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 60 lpm-pol 0 [ 6.068613] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 60 lpm-pol 0 [ 6.068616] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 60 lpm-pol 0 [ 6.068619] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 60 lpm-pol 0 [ 6.076297] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.076299] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.087591] igb 0000:07:00.0: added PHC on eth0 [ 6.087619] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.087620] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2c [ 6.087696] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.087697] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.142988] igb 0000:07:00.1: added PHC on eth1 [ 6.143032] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.143033] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2d [ 6.143123] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.143123] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.278676] ACPI: bus type drm_connector registered [ 6.359207] ata2: SATA link down (SStatus 0 SControl 300) [ 6.359256] ata4: SATA link down (SStatus 0 SControl 300) [ 6.359286] ata3: SATA link down (SStatus 0 SControl 300) [ 6.359453] ata1: SATA link down (SStatus 0 SControl 300) [ 6.374759] ata9: SATA link down (SStatus 0 SControl 300) [ 6.374783] ata8: SATA link down (SStatus 0 SControl 300) [ 6.374809] ata6: SATA link down (SStatus 0 SControl 300) [ 6.375262] ata7: SATA link down (SStatus 0 SControl 300) [ 6.375343] ata10: SATA link down (SStatus 0 SControl 300) [ 6.375368] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.376412] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.376954] ata5.00: NCQ Send/Recv Log not supported [ 6.376956] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.378409] ata5.00: NCQ Send/Recv Log not supported [ 6.378413] ata5.00: configured for UDMA/133 [ 6.378519] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.403496] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.454857] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.460894] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.468921] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.468937] sd 4:0:0:0: [sda] Write Protect is off [ 6.468955] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.468975] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.490485] sda: sda1 [ 6.490555] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.504937] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.513903] Console: switching to colour dummy device 80x25 [ 6.514062] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.514064] ast 0000:06:00.0: AST 2400 detected [ 6.514113] ast 0000:06:00.0: [drm] Using analog VGA [ 6.514122] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.519659] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.525407] fbcon: astdrmfb (fb0) is primary device [ 6.554818] Console: switching to colour frame buffer device 128x48 [ 6.572243] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.230941] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.231234] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.231317] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.231318] ixgbe 0000:03:00.0: 0c:c4:7a:88:7f:90 [ 7.234621] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.391864] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.392154] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.392236] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.392238] ixgbe 0000:03:00.1: 0c:c4:7a:88:7f:91 [ 7.395473] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.411205] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.434928] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.674429] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 7.980754] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). Starting Switch Root... [ 8.481261] SELinux: policy capability network_peer_controls=1 [ 8.481269] SELinux: policy capability open_perms=1 [ 8.481270] SELinux: policy capability extended_socket_class=1 [ 8.481270] SELinux: policy capability always_check_network=0 [ 8.481271] SELinux: policy capability cgroup_seclabel=1 [ 8.481272] SELinux: policy capability nnp_nosuid_transition=1 [ 8.481273] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.523400] audit: type=1403 audit(1726178004.940:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.525195] systemd[1]: Successfully loaded SELinux policy in 106.047ms. [ 8.594625] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.732ms. [ 8.606855] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.606979] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.498388] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.498486] systemd[1]: Stopped Switch Root. [ 9.505820] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.506111] systemd[1]: Created slice Slice /system/getty. [ 9.510129] systemd[1]: Created slice Slice /system/modprobe. [ OK [[ 9.518979] systemd[1]: Created slice Slice /system/serial-getty. [ 9.524455] systemd[1]: Created slice Slice /system/sshd-keygen. 0m] Stopped [0;[ 9.543681] systemd[1]: Created slice User and Session Slice. 1;39mSwitch Root[ 9.550567] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.550664] systemd[1]: Started Forward Password Requests to Wall Directory Watch. . [[ 9.567198] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.574472] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. OK ] Crea[ 9.585222] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.595547] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. ted slice [0;1;[ 9.595570] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.607267] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. 39mSlice /system[ 9.617600] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.617621] systemd[1]: Reached target Local Encrypted Volumes. /getty. [[ 9.629318] systemd[1]: Stopped target Switch Root. [ 9.639988] systemd[1]: Stopped target Initrd File Systems. [0;32m OK [ 9.640008] systemd[1]: Stopped target Initrd Root File System. [ 9.652311] systemd[1]: Reached target Local Integrity Protected Volumes. ] Created slice [ 9.658238] systemd[1]: Reached target Path Units. [ 9.664490] systemd[1]: Reached target Slice Units. Slice /[ 9.670048] systemd[1]: Reached target Swaps. [ 9.670070] systemd[1]: Reached target Local Verity Protected Volumes. system/modprobe[ 9.677682] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.685004] systemd[1]: Listening on LVM2 poll daemon socket. [0m. [ [ 9.709863] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.715356] systemd[1]: Reached target RPC Port Mapper. OK ] Creat[ 9.728003] systemd[1]: Listening on Process Core Dump Socket. [ 9.729072] systemd[1]: Listening on initctl Compatibility Named Pipe. ed slice [0;1;3[ 9.734881] systemd[1]: Listening on udev Control Socket. [ 9.741624] systemd[1]: Listening on udev Kernel Socket. 9mSlice /system/[ 9.748760] systemd[1]: Mounting Huge Pages File System... [ 9.755536] systemd[1]: Mounting POSIX Message Queue File System... serial-getty[ 9.760820] systemd[1]: Mounting Kernel Debug File System... [ 9.767612] systemd[1]: Mounting Kernel Trace File System... . [ OK[ 9.773175] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 9.797951] systemd[1]: Starting Create List of Static Device Nodes... ] Created [ 9.801176] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.807692] systemd[1]: Starting Load Kernel Module configfs... slice S[ 9.819288] systemd[1]: Starting Load Kernel Module drm... [ 9.825242] systemd[1]: Starting Load Kernel Module fuse... lice /system/ssh[ 9.833019] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.836920] systemd[1]: plymouth-switch-root.service: Deactivated successfully. d-keygen. [ 9.836965] systemd[1]: Stopped Plymouth switch root service. [ 9.846774] systemd[1]: Stopped Journal Service. [ OK [[ 9.866286] systemd[1]: Starting Journal Service... [ 9.868352] systemd[1]: Starting Load Kernel Modules... 0m] Created slic[ 9.872956] systemd[1]: Starting Generate network units from Kernel command line... [ 9.877173] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). e User [ 9.878105] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.886207] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. and Session Slic[ 9.887040] systemd[1]: Starting Coldplug All udev Devices... [ 9.905714] systemd[1]: Mounted Huge Pages File System. e. [[0;32[ 9.912904] systemd[1]: Mounted POSIX Message Queue File System. [ 9.922292] systemd[1]: Started Journal Service. m OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [[ 9.972012] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none.  OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.servic[ 10.025584] systemd-journald[578]: Received client request to flush runtime journal. e instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on u[ 10.139302] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.139323] device-mapper: uevent: version 1.0.3 dev Kernel Socke[ 10.139415] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com t. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.576044] IPMI message handler: version 39.2 [ 10.585339] ipmi device interface [ 10.593823] ipmi_si: IPMI System Interface driver [ 10.593835] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.593837] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.593839] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.593869] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.593939] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.594395] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.594396] ipmi_si: Adding ACPI-specified kcs state machine [ 10.594441] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.656524] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.659085] power_meter ACPI000D:00: Found ACPI power meter. [ 10.659109] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.659114] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.664553] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.675518] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.695625] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.697984] igb 0000:07:00.0: DCA enabled [ 10.698001] igb 0000:07:00.1: DCA enabled [ 10.737455] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.738375] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.750862] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.752596] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.752599] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.752600] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.772532] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started /usr/sbin/lvm vgchange -aay[ 10.789155] ipmi_ssif: IPMI SSIF Interface driver --autoactivation event vg_nvme. [ 10.857480] iTCO_vendor_support: vendor-support=0 [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 10.908372] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.908612] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.303403] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.311173] RPC: Registered named UNIX socket transport module. [ 11.311176] RPC: Registered udp transport module. [ 11.311178] RPC: Registered tcp transport module. [ 11.311178] RPC: Registered tcp-with-tls transport module. [ 11.311179] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 11.311710] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.311810] XFS (dm-4): Mounting V4 Filesystem 51d22dd6-e15f-473b-a361-95e820bd1af8 [ 11.315863] XFS (dm-4): Ending clean mount [ 11.315904] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.386682] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 13.386685] EDAC sbridge: Ver: 1.1.2 [ 13.457587] intel_rapl_common: Found RAPL domain package [ 13.457598] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.156496] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.308850] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.533600] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 15.729662] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.729800] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.172 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + '[' 172.21.15.172 '!=' '' ']' + set -e + '[' -n 172.21.15.172 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.172 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.172 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 22.470363] block sda: the capability attribute has been deprecated. + newhostname=smithi172.front.sepia.ceph.com + '[' -n smithi172.front.sepia.ceph.com ']' + hostname smithi172.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi172 + echo smithi172 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.172 smithi172.front.sepia.ceph.com smithi172/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T21:53:45.325 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-09-12T21:53:45.378 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 7F 91 GUID: 00000000 0000 0000 0000 0CC47AD9172C DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.172 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:7f:91)... Configuring (net0 0c:c4:7a:88:7f:91).... Configuring (net0 0c:c4:7a:88:7f:91)..... Configuring (net0 0c:c4:7a:88:7f:91)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              CentOS Stream (5.14.0-503.el9.x86_64) 9  The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.080 MHz processor [ 0.000410] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000414] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000745] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006405] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006414] Using GB pages for direct mapping [ 0.006566] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006568] ACPI: Early table checksum verification disabled [ 0.006571] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006574] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006578] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006582] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006585] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006586] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006589] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006591] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006593] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006595] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006598] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006600] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006602] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006604] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006606] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006609] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006611] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006613] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006615] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006618] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006620] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006622] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006624] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006626] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006627] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006628] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006628] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006629] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006630] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006630] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006631] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006631] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006632] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006633] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006633] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006634] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006634] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006635] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006635] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006636] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006637] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006637] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006638] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006638] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006685] No NUMA configuration found [ 0.006686] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006694] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006866] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006902] Zone ranges: [ 0.006902] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006904] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006905] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006906] Device empty [ 0.006907] Movable zone start for each node [ 0.006909] Early memory node ranges [ 0.006909] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006910] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006911] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006915] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006919] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006955] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011813] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011925] ACPI: PM-Timer IO Port: 0x408 [ 0.011934] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011935] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011936] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011936] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011937] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011938] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011938] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011939] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011948] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011952] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011954] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011955] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011959] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011960] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011964] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011969] CPU topo: Max. logical packages: 1 [ 0.011970] CPU topo: Max. logical dies: 1 [ 0.011970] CPU topo: Max. dies per package: 1 [ 0.011974] CPU topo: Max. threads per core: 2 [ 0.011975] CPU topo: Num. cores per package: 4 [ 0.011976] CPU topo: Num. threads per package: 8 [ 0.011976] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011985] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011986] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011987] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011988] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011989] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011989] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011990] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011990] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011991] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011993] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011994] Booting paravirtualized kernel on bare hardware [ 0.011997] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016392] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016613] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016635] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016688] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016703] random: crng init done [ 0.018886] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020029] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020134] Fallback order for Node 0: 0 [ 0.020137] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020138] Policy zone: Normal [ 0.020280] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020289] software IO TLB: area num 8. [ 0.041894] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989836K reserved, 0K cma-reserved) [ 0.041996] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.042004] Kernel/User page tables isolation: enabled [ 0.042028] ftrace: allocating 48134 entries in 189 pages [ 0.048938] ftrace: allocated 189 pages with 6 groups [ 0.049467] Dynamic Preempt: voluntary [ 0.049509] rcu: Preemptible hierarchical RCU implementation. [ 0.049510] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.049511] Trampoline variant of Tasks RCU enabled. [ 0.049511] Rude variant of Tasks RCU enabled. [ 0.049512] Tracing variant of Tasks RCU enabled. [ 0.049513] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.049513] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052986] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.053148] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.053257] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.058520] Console: colour VGA+ 80x25 [ 0.058537] printk: console [ttyS1] enabled [ 1.128988] ACPI: Core revision 20230331 [ 1.133081] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.142208] APIC: Switch to symmetric I/O mode setup [ 1.147179] DMAR: Host address width 46 [ 1.151022] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.156338] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.164332] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.170598] DMAR: ATSR flags: 0x0 [ 1.173918] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.180183] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.186536] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192888] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.198287] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.198288] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.213318] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.218622] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.224834] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.235206] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32739cab026, max_idle_ns: 440795371541 ns [ 1.245717] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.16 BogoMIPS (lpj=3500080) [ 1.246735] CPU0: Thermal monitoring enabled (TM1) [ 1.247772] process: using mwait in idle threads [ 1.248717] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.249716] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.250717] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.251717] Spectre V2 : Mitigation: Retpolines [ 1.253716] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.254716] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.255716] Speculative Store Bypass: Vulnerable [ 1.256721] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257716] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.258716] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.259719] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.260716] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.261716] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.262716] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.263716] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.276385] Freeing SMP alternatives memory: 40K [ 1.276716] pid_max: default: 32768 minimum: 301 [ 1.277735] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.278720] Yama: becoming mindful. [ 1.279722] SELinux: Initializing. [ 1.280732] LSM support for eBPF active [ 1.281775] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.282754] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.386808] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.388820] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.389728] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.390725] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.391724] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.392717] ... version: 3 [ 1.393716] ... bit width: 48 [ 1.394716] ... generic registers: 4 [ 1.395716] ... value mask: 0000ffffffffffff [ 1.396716] ... max period: 00007fffffffffff [ 1.397716] ... fixed-purpose events: 3 [ 1.398716] ... event mask: 000000070000000f [ 1.399799] signal: max sigframe size: 1776 [ 1.400727] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.401742] rcu: Hierarchical SRCU implementation. [ 1.401743] rcu: Max phase no-delay instances is 400. [ 1.405188] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.405784] smp: Bringing up secondary CPUs ... [ 1.406782] smpboot: x86: Booting SMP configuration: [ 1.406783] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.409975] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.409975] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.409975] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.414745] smp: Brought up 1 node, 8 CPUs [ 1.414745] smpboot: Total of 8 processors activated (56001.28 BogoMIPS) [ 1.458576] node 0 deferred pages initialised in 40ms [ 1.460744] devtmpfs: initialized [ 1.460746] x86/mm: Memory block size: 128MB [ 1.461715] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.461715] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.461715] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.461715] pinctrl core: initialized pinctrl subsystem [ 1.466715] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.466717] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.466717] audit: initializing netlink subsys (disabled) [ 1.466725] audit: type=2000 audit(1726177996.241:1): state=initialized audit_enabled=0 res=1 [ 1.466785] thermal_sys: Registered thermal governor 'fair_share' [ 1.466786] thermal_sys: Registered thermal governor 'step_wise' [ 1.466786] thermal_sys: Registered thermal governor 'user_space' [ 1.467718] cpuidle: using governor menu [ 1.468735] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.468736] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.468793] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.468803] PCI: Using configuration type 1 for base access [ 1.472744] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.472749] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.472749] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.472749] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.472749] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.473744] cryptd: max_cpu_qlen set to 1000 [ 1.473783] ACPI: Added _OSI(Module Device) [ 1.473784] ACPI: Added _OSI(Processor Device) [ 1.473785] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.473786] ACPI: Added _OSI(Processor Aggregator Device) [ 1.473786] ACPI: Added _OSI(Linux-Dell-Video) [ 1.473788] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.473789] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.478306] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.478715] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.478715] ACPI: Dynamic OEM Table Load: [ 1.496997] ACPI: _OSC evaluated successfully for all CPUs [ 1.497261] ACPI: Interpreter enabled [ 1.497271] ACPI: PM: (supports S0 S4 S5) [ 1.497271] ACPI: Using IOAPIC for interrupt routing [ 1.498769] HEST: Enabling Firmware First mode for corrected errors. [ 1.529301] HEST: Table parsing has been initialized. [ 1.529418] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.529420] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.529420] PCI: Using E820 reservations for host bridge windows [ 1.529861] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.550803] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.550808] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.551930] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.552465] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.552466] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.552494] PCI host bridge to bus 0000:ff [ 1.552495] pci_bus 0000:ff: root bus resource [bus ff] [ 1.552506] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.552549] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.552580] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.552610] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.552642] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.552672] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.552700] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.552732] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.552762] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.552791] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.552821] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.552850] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.552880] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.552910] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.552939] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.552971] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.552999] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.553028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.553059] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.553082] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.553118] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553179] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553238] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553305] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553364] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553424] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553465] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.553496] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.553530] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553573] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553615] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553657] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553697] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.553731] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.553762] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.553793] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.553826] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553868] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553910] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553952] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.553996] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.554031] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.554063] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.554095] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.554129] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.554160] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.554191] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.554222] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.554256] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.554286] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.554317] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.554348] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.554371] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.554402] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.554433] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.556678] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.556681] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.556816] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.557059] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.557060] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.557472] PCI host bridge to bus 0000:00 [ 1.557474] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.557475] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.557476] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.557477] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.557478] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.557479] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.557480] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.557499] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.557603] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.557615] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.557652] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.557747] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.557759] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.557762] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.557796] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.557886] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.557898] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.557900] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.557901] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.557906] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.557936] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.558022] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558029] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.558109] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558117] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.558195] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558202] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.558276] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558284] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.558361] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558368] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.558443] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558450] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.558524] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558531] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.558607] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558615] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.558688] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558752] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558837] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.558894] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.558900] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.558981] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.559222] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.559241] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.559253] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.559264] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.559275] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.559286] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.559297] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.559355] pci 0000:00:11.4: PME# supported from D3hot [ 1.559434] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.559458] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.559544] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.559635] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.559660] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.559748] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.559815] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.559840] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.559927] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.560013] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.560034] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.560147] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.560230] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.560268] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.560360] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.560460] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.560496] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.560501] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.560504] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.560592] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.560696] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.560733] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.560738] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.560742] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.560830] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.560937] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.560959] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.561073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.561153] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.561356] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.561373] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.561385] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.561395] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.561406] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.561416] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.561427] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.561480] pci 0000:00:1f.2: PME# supported from D3hot [ 1.561542] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.561566] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.561595] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.561759] acpiphp: Slot [1] registered [ 1.561770] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.561875] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.561884] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.561900] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.561904] pci 0000:02:00.0: enabling Extended Tags [ 1.562009] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.562116] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.562127] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.562131] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.562141]m 0xfbe04000-0xf] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.562183] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.562200] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562201] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.562209] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562210] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.562364] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.562375] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.562379] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.562389] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.562394] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.562431] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.562445] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562446] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.56 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.562456[mem 0x00000000-AR 3 for 64 VFs [ 1.562595] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.562641] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.562734] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.562806] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.562819] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.562824] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.562878] pci 0000:05:00.0: enabling Extended Tags [ 1.563015] pci 0000:05:00.0: supports D1 D2 [ 1.563016] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.563199] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.563287] pci_bus 0000:06: extended config space not accessible [ 1.563322] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.563359] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.563379] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.563399] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.563498] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.563568] pci 0000:06:00.0: supports D1 D2 [ 1.563569] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.563721] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.563867] pc] type 00 class 0x020000 PCIe Endpoint [ 1.563900] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.563937] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.563952] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.564187] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.564247] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564248] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.564282] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564283] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.564626] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.564660] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.5646:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.564716] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.564941] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.564998] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.564999] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.565032] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.565033] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.565337] pci 0000:00:1ce to [bus 07] [ 1.565348] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.566013] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.566045] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.566074] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.566104] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.566134] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.566135] ACPI: PCI: Interrupt link LNKE disabled [ 1.566164] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.566165] ACPI: PCI: Interrupt link LNKF disabled [ 1.566195] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.566195] ACPI: PCI: Interrupt link LNKG disabled [ 1.566225] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.566225] ACPI: PCI: Interrupt link LNKH disabled [ 1.566733] iommu: Default domain type: Translated [ 1.566733] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.566784] SCSI subsystem initialized [ 1.566801] ACPI: bus type USB registered [ 1.566814] usbcore: registered new interface driver usbfs [ 1.566819] usbcore: registered new interface driver hub [ 1.566824] usbcore: registered new device driver usb [ 1.566843] pps_core: LinuxPPS API ver. 1 registered [ 1.566844] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.566846] PTP clock support registered [ 1.566859] EDAC MC: Ver: 3.0.0 [ 1.566873] NetLabel: Initializing [ 1.566874] NetLabel: domain hash size = 128 [ 1.566875] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.566887] NetLabel: unlabeled traffic allowed by default [ 1.566888] PCI: Using ACPI for IRQ routing [ 1.577736] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.577738] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.577739] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.577740] vgaarb: loaded [ 1.577747] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.577751] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.585282] clocksource: Switched to clocksource tsc-early [ 1.593828] VFS: Disk quotas dquot_6.6.0 [ 1.593842] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.593909] pnp: PnP ACPI init [ 1.594229] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.594232] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.594233] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.594234] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.594235] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.594236] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.594237] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.594238] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.594239] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.594240] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.594241] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.594242] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.594243] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.594388] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.594389] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.594390] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.594391] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.594392] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.595059] pnp: PnP ACPI: found 5 devices [ 1.600520] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.600569] NET: Registered PF_INET protocol family [ 1.600734] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.602991] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.603023] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.603033] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.603264] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.603380] TCP: Hash tables configured (established 262144 bind 65536) [ 1.603505] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.603597] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.603655] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.603741] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.603745] NET: Registered PF_XDP protocol family [ 1.603768] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.603778] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.603781] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.603786] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.603788] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.603794] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603795] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603797] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603797] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603799] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603800] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603801] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603802] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603803] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603804] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603805] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603806] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603807] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603808] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603810] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.603810] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.603812] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.603813] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.603815] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.603816] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.603820] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.603833] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.603837] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.603845] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.603860] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.603862] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.603867] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.603877] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.603885] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.603891] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.603897] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.603903] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.603905] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.603910] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.603914] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.603921] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.603922] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.603923] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.603924] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.603925] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.603925] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.603926] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.603927] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.603928] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.603929] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.603930] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.603931] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.603932] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.603933] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.603933] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.603934] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.603935] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.603936] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.604098] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.620584] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15929 usecs [ 1.636581] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15607 usecs [ 1.636594] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.636629] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.636629] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.636636] ACPI: bus type thunderbolt registered [ 1.636654] Trying to unpack rootfs image as initramfs... [ 1.785815] Initialise system trusted keyrings [ 1.785826] Key type blacklist registered [ 1.785873] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.785886] zbud: loaded [ 1.900137] integrity: Platform Keyring initialized [ 1.900144] integrity: Machine keyring initialized [ 1.907882] NET: Registered PF_ALG protocol family [ 1.907884] xor: automatically using best checksumming function avx [ 1.907886] Key type asymmetric registered [ 1.907887] Asymmetric key parser 'x509' registered [ 1.907888] Running certificate verification selftests [ 1.909698] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.910302] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.910330] io scheduler mq-deadline registered [ 1.910331] io scheduler kyber registered [ 1.910338] io scheduler bfq registered [ 1.944480] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.944820] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.944979] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.945124] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.945258] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.945412] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.945565] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.945721] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.945938] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.956188] Freeing initrd memory: 31720K [ 1.970733] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.970757] ACPI: button: Power Button [PWRB] [ 1.970779] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.970846] ACPI: button: Power Button [PWRF] [ 1.989799] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.989801] pstore: Registered erst as persistent store backend [ 1.989908] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.990011] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.998272] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.006927] Non-volatile memory driver v1.3 [ 2.064631] rdac: device handler registered [ 2.064656] hp_sw: device handler registered [ 2.064657] emc: device handler registered [ 2.064675] alua: device handler registered [ 2.064949] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.064991] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.065004] ehci-pci 0000:00:1a.0: debug port 2 [ 2.068937] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.075572] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.075608] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.075610] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.075611] usb usb1: Product: EHCI Host Controller [ 2.075612] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.075613] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.075703] hub 1-0:1.0: USB hub found [ 2.075707] hub 1-0:1.0: 2 ports detected [ 2.075817] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.075852] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.076935] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.077181] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.077183] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.077203] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.077205] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.077245] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 2.077258] ehci-pci 0000:00:1d.0: debug port 2 [ 2.077278] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.077281] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.077283] usb usb2: Product: xHCI Host Controller [ 2.077283] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.077284] usb usb2: SerialNumber: 0000:00:14.0 [ 2.077384] hub 2-0:1.0: USB hub found [ 2.077420] hub 2-0:1.0: 15 ports detected [ 2.079984] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.079986] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.079987] usb usb3: Product: xHCI Host Controller [ 2.079987] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.079988] usb usb3: SerialNumber: 0000:00:14.0 [ 2.080054] hub 3-0:1.0: USB hub found [ 2.080070] hub 3-0:1.0: 6 ports detected [ 2.081018] usbcore: registered new interface driver usbserial_generic [ 2.081022] usbserial: USB Serial support registered for generic [ 2.081049] i8042: PNP: No PS/2 controller found. [ 2.081075] mousedev: PS/2 mouse device common for all mice [ 2.081131] rtc_cmos 00:00: RTC can wake from S4 [ 2.081170] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.081412] rtc_cmos 00:00: registered as rtc0 [ 2.081457] rtc_cmos 00:00: setting system clock to 2024-09-12T21:53:18 UTC (1726177998) [ 2.081479] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.087571] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.087601] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.087603] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.087604] usb usb4: Product: EHCI Host Controller [ 2.087605] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.087605] usb usb4: SerialNumber: 0000:00:1d.0 [ 2.087682] hub 4-0:1.0: USB hub found [ 2.087685] hub 4-0:1.0: 2 ports detected [ 2.097440] intel_pstate: Intel P-state driver initializing [ 2.153894] hid: raw HID events driver (C) Jiri Kosina [ 2.153923] usbcore: registered new interface driver usbhid [ 2.153924] usbhid: USB HID core driver [ 2.153951] drop_monitor: Initializing network drop monitor service [ 2.163332] Initializing XFRM netlink socket [ 2.163352] NET: Registered PF_INET6 protocol family [ 2.168169] Segment Routing with IPv6 [ 2.168186] NET: Registered PF_PACKET protocol family [ 2.168210] mpls_gso: MPLS GSO support [ 2.234194] microcode: Current revision: 0x0b00001b [ 2.247560] resctrl: L3 allocation detected [ 2.247561] resctrl: L3 monitoring detected [ 2.247573] IPI shorthand broadcast: enabled [ 2.247578] AVX2 version of gcm_enc/dec engaged. [ 2.304301] AES CTR mode by8 optimization enabled [ 2.304345] sched_clock: Marking stable (1131000670, 1172538943)->(2841537163, -537997550) [ 2.315577] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.320135] registered taskstats version 1 [ 2.323543] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.331551] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.345315] Loading compiled-in X.509 certificates [ 2.345803] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.346083] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.346356] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.346498] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.346507] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.348248] page_owner is disabled [ 2.348464] pstore: Using crash dump compression: deflate [ 2.348475] Key type big_key registered [ 2.441715] Key type encrypted registered [ 2.441722] ima: No TPM chip found, activating TPM-bypass! [ 2.441725] Loading compiled-in module X.509 certificates [ 2.442012] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.442015] ima: Allocated hash algorithm: sha256 [ 2.442024] ima: No architecture policies found [ 2.442035] evm: Initialising EVM extended attributes: [ 2.442036] evm: security.selinux [ 2.442036] evm: security.SMACK64 (disabled) [ 2.442037] evm: security.SMACK64EXEC (disabled) [ 2.442037] evm: security.SMACK64TRANSMUTE (disabled) [ 2.442038] evm: security.SMACK64MMAP (disabled) [ 2.442038] evm: security.apparmor (disabled) [ 2.442038] evm: security.ima [ 2.442039] evm: security.capability [ 2.442039] evm: HMAC attrs: 0x1 [ 2.456845] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.456847] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.457127] hub 4-1:1.0: USB hub found [ 2.457220] hub 4-1:1.0: 8 ports detected [ 2.463847] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.463850] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.464010] hub 1-1:1.0: USB hub found [ 2.464095] hub 1-1:1.0: 6 ports detected [ 2.501568] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.501572] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.523307] hub 2-12:1.0: USB hub found [ 2.528437] hub 2-12:1.0: 4 ports detected [ 2.665569] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 2.665573] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 2.668057] clocksource: Switched to clocksource tsc [ 2.947546] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.098548] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.098551] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.156894] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.208672] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.218644] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.218731] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.145837] clk: Disabling unused clocks [ 5.150654] Freeing unused decrypted memory: 2028K [ 5.155922] Freeing unused kernel image (initmem) memory: 3980K [ 5.161832] Write protecting the kernel read-only data: 30720k [ 5.167938] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.212482] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.212484] x86/mm: Checking user space page tables [ 5.249129] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.249138] Run /init as init process [ 5.259330] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.259433] systemd[1]: Detected architecture x86-64. [ 5.259435] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.309683] systemd[1]: Hostname set to . [ 5.367591] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.367709] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.389705] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.403611] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.415686] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.426637] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.438663] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.453798] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.467675] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.479729] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.493709] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.507628] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.526257] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.541636] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.554281] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.567192] systemd[1]: Starting Create System Users... Starting Creat[ 5.573888] fuse: init (API version 7.36) e System Users... [ 5.583205] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.596310] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show [ 5.973473] dca service started, version 1.12.1 Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.023469] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.023477] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.024815] nvme nvme0: pci function 0000:02:00.0 [ 6.029919] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.029923] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.029925] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.039159] nvme nvme0: 8/0/0 default/read/poll queues [ 6.051328] scsi host0: ahci [ 6.051561] scsi host1: ahci [ 6.052054] scsi host2: ahci [ 6.052421] scsi host3: ahci [ 6.052469] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 51 lpm-pol 0 [ 6.052472] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 51 lpm-pol 0 [ 6.052474] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 51 lpm-pol 0 [ 6.052476] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 51 lpm-pol 0 [ 6.052775] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.052779] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.052781] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.068005] scsi host4: ahci [ 6.068120] scsi host5: ahci [ 6.068228] scsi host6: ahci [ 6.068336] scsi host7: ahci [ 6.068447] scsi host8: ahci [ 6.068556] scsi host9: ahci [ 6.068604] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 60 lpm-pol 0 [ 6.068608] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 60 lpm-pol 0 [ 6.068611] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 60 lpm-pol 0 [ 6.068613] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 60 lpm-pol 0 [ 6.068616] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 60 lpm-pol 0 [ 6.068619] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 60 lpm-pol 0 [ 6.076297] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.076299] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.087591] igb 0000:07:00.0: added PHC on eth0 [ 6.087619] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.087620] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2c [ 6.087696] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.087697] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.142988] igb 0000:07:00.1: added PHC on eth1 [ 6.143032] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.143033] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:17:2d [ 6.143123] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.143123] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.278676] ACPI: bus type drm_connector registered [ 6.359207] ata2: SATA link down (SStatus 0 SControl 300) [ 6.359256] ata4: SATA link down (SStatus 0 SControl 300) [ 6.359286] ata3: SATA link down (SStatus 0 SControl 300) [ 6.359453] ata1: SATA link down (SStatus 0 SControl 300) [ 6.374759] ata9: SATA link down (SStatus 0 SControl 300) [ 6.374783] ata8: SATA link down (SStatus 0 SControl 300) [ 6.374809] ata6: SATA link down (SStatus 0 SControl 300) [ 6.375262] ata7: SATA link down (SStatus 0 SControl 300) [ 6.375343] ata10: SATA link down (SStatus 0 SControl 300) [ 6.375368] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.376412] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.376954] ata5.00: NCQ Send/Recv Log not supported [ 6.376956] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.378409] ata5.00: NCQ Send/Recv Log not supported [ 6.378413] ata5.00: configured for UDMA/133 [ 6.378519] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.403496] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.454857] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.460894] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.468921] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.468937] sd 4:0:0:0: [sda] Write Protect is off [ 6.468955] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.468975] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.490485] sda: sda1 [ 6.490555] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.504937] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.513903] Console: switching to colour dummy device 80x25 [ 6.514062] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.514064] ast 0000:06:00.0: AST 2400 detected [ 6.514113] ast 0000:06:00.0: [drm] Using analog VGA [ 6.514122] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.519659] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.525407] fbcon: astdrmfb (fb0) is primary device [ 6.554818] Console: switching to colour frame buffer device 128x48 [ 6.572243] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.230941] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.231234] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.231317] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.231318] ixgbe 0000:03:00.0: 0c:c4:7a:88:7f:90 [ 7.234621] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.391864] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.392154] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.392236] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.392238] ixgbe 0000:03:00.1: 0c:c4:7a:88:7f:91 [ 7.395473] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.411205] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.434928] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.674429] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 7.980754] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). Starting Switch Root... [ 8.481261] SELinux: policy capability network_peer_controls=1 [ 8.481269] SELinux: policy capability open_perms=1 [ 8.481270] SELinux: policy capability extended_socket_class=1 [ 8.481270] SELinux: policy capability always_check_network=0 [ 8.481271] SELinux: policy capability cgroup_seclabel=1 [ 8.481272] SELinux: policy capability nnp_nosuid_transition=1 [ 8.481273] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.523400] audit: type=1403 audit(1726178004.940:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.525195] systemd[1]: Successfully loaded SELinux policy in 106.047ms. [ 8.594625] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.732ms. [ 8.606855] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.606979] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.498388] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.498486] systemd[1]: Stopped Switch Root. [ 9.505820] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.506111] systemd[1]: Created slice Slice /system/getty. [ 9.510129] systemd[1]: Created slice Slice /system/modprobe. [ OK [[ 9.518979] systemd[1]: Created slice Slice /system/serial-getty. [ 9.524455] systemd[1]: Created slice Slice /system/sshd-keygen. 0m] Stopped [0;[ 9.543681] systemd[1]: Created slice User and Session Slice. 1;39mSwitch Root[ 9.550567] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.550664] systemd[1]: Started Forward Password Requests to Wall Directory Watch. . [[ 9.567198] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.574472] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. OK ] Crea[ 9.585222] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.595547] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. ted slice [0;1;[ 9.595570] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.607267] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. 39mSlice /system[ 9.617600] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.617621] systemd[1]: Reached target Local Encrypted Volumes. /getty. [[ 9.629318] systemd[1]: Stopped target Switch Root. [ 9.639988] systemd[1]: Stopped target Initrd File Systems. [0;32m OK [ 9.640008] systemd[1]: Stopped target Initrd Root File System. [ 9.652311] systemd[1]: Reached target Local Integrity Protected Volumes. ] Created slice [ 9.658238] systemd[1]: Reached target Path Units. [ 9.664490] systemd[1]: Reached target Slice Units. Slice /[ 9.670048] systemd[1]: Reached target Swaps. [ 9.670070] systemd[1]: Reached target Local Verity Protected Volumes. system/modprobe[ 9.677682] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.685004] systemd[1]: Listening on LVM2 poll daemon socket. [0m. [ [ 9.709863] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.715356] systemd[1]: Reached target RPC Port Mapper. OK ] Creat[ 9.728003] systemd[1]: Listening on Process Core Dump Socket. [ 9.729072] systemd[1]: Listening on initctl Compatibility Named Pipe. ed slice [0;1;3[ 9.734881] systemd[1]: Listening on udev Control Socket. [ 9.741624] systemd[1]: Listening on udev Kernel Socket. 9mSlice /system/[ 9.748760] systemd[1]: Mounting Huge Pages File System... [ 9.755536] systemd[1]: Mounting POSIX Message Queue File System... serial-getty[ 9.760820] systemd[1]: Mounting Kernel Debug File System... [ 9.767612] systemd[1]: Mounting Kernel Trace File System... . [ OK[ 9.773175] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 9.797951] systemd[1]: Starting Create List of Static Device Nodes... ] Created [ 9.801176] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.807692] systemd[1]: Starting Load Kernel Module configfs... slice S[ 9.819288] systemd[1]: Starting Load Kernel Module drm... [ 9.825242] systemd[1]: Starting Load Kernel Module fuse... lice /system/ssh[ 9.833019] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.836920] systemd[1]: plymouth-switch-root.service: Deactivated successfully. d-keygen. [ 9.836965] systemd[1]: Stopped Plymouth switch root service. [ 9.846774] systemd[1]: Stopped Journal Service. [ OK [[ 9.866286] systemd[1]: Starting Journal Service... [ 9.868352] systemd[1]: Starting Load Kernel Modules... 0m] Created slic[ 9.872956] systemd[1]: Starting Generate network units from Kernel command line... [ 9.877173] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). e User [ 9.878105] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.886207] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. and Session Slic[ 9.887040] systemd[1]: Starting Coldplug All udev Devices... [ 9.905714] systemd[1]: Mounted Huge Pages File System. e. [[0;32[ 9.912904] systemd[1]: Mounted POSIX Message Queue File System. [ 9.922292] systemd[1]: Started Journal Service. m OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [[ 9.972012] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none.  OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.servic[ 10.025584] systemd-journald[578]: Received client request to flush runtime journal. e instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on u[ 10.139302] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.139323] device-mapper: uevent: version 1.0.3 dev Kernel Socke[ 10.139415] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com t. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.576044] IPMI message handler: version 39.2 [ 10.585339] ipmi device interface [ 10.593823] ipmi_si: IPMI System Interface driver [ 10.593835] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.593837] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.593839] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.593869] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.593939] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.594395] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.594396] ipmi_si: Adding ACPI-specified kcs state machine [ 10.594441] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.656524] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.659085] power_meter ACPI000D:00: Found ACPI power meter. [ 10.659109] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.659114] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.664553] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.675518] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.695625] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.697984] igb 0000:07:00.0: DCA enabled [ 10.698001] igb 0000:07:00.1: DCA enabled [ 10.737455] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.738375] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.750862] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.752596] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.752599] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.752600] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.772532] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started /usr/sbin/lvm vgchange -aay[ 10.789155] ipmi_ssif: IPMI SSIF Interface driver --autoactivation event vg_nvme. [ 10.857480] iTCO_vendor_support: vendor-support=0 [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 10.908372] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.908612] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.303403] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.311173] RPC: Registered named UNIX socket transport module. [ 11.311176] RPC: Registered udp transport module. [ 11.311178] RPC: Registered tcp transport module. [ 11.311178] RPC: Registered tcp-with-tls transport module. [ 11.311179] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 11.311710] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.311810] XFS (dm-4): Mounting V4 Filesystem 51d22dd6-e15f-473b-a361-95e820bd1af8 [ 11.315863] XFS (dm-4): Ending clean mount [ 11.315904] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.386682] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 13.386685] EDAC sbridge: Ver: 1.1.2 [ 13.457587] intel_rapl_common: Found RAPL domain package [ 13.457598] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.156496] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.308850] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.533600] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 15.729662] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.729800] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.172 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + '[' 172.21.15.172 '!=' '' ']' + set -e + '[' -n 172.21.15.172 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.172 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.172 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 22.470363] block sda: the capability attribute has been deprecated. + newhostname=smithi172.front.sepia.ceph.com + '[' -n smithi172.front.sepia.ceph.com ']' + hostname smithi172.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi172 + echo smithi172 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.172 smithi172.front.sepia.ceph.com smithi172/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi172 login: [disconnect] 2024-09-12T21:53:45.480 INFO:teuthology.misc:Re-opening connections... 2024-09-12T21:53:45.480 INFO:teuthology.misc:trying to connect to ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:53:45.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:53:45.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:53:45.794 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-12T21:53:46.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T21:53:46.183 DEBUG:teuthology.misc:waited 0.7032897472381592 2024-09-12T21:53:47.184 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:53:47.184 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi172.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-09-12T21:53:47.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T21:53:47.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:53:47.405 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T21:53:47.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T21:53:47.408 INFO:tasks.ceph.osd.2:Started 2024-09-12T21:53:47.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:53:47.594 INFO:teuthology.orchestra.run.smithi172.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T21:53:47.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:53:47.599 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T21:53:49.605 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:53:49.603+0000 7f2de380d640 -1 Falling back to public interface 2024-09-12T21:53:50.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T21:53:52.600 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:0 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:1 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:2 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:abort 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:assert 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs debug_inject_read_zeros 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs files list 2024-09-12T21:53:52.714 INFO:teuthology.orchestra.run.smithi172.stderr:bluefs stats 2024-09-12T21:53:52.715 INFO:teuthology.orchestra.run.smithi172.stderr:bluestore bluefs device info [] 2024-09-12T21:53:52.715 INFO:teuthology.orchestra.run.smithi172.stderr:config diff 2024-09-12T21:53:52.715 INFO:teuthology.orchestra.run.smithi172.stderr:admin_socket: invalid command 2024-09-12T21:53:52.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:53:52.717 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T21:53:55.304 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:53:55.303+0000 7f2de380d640 -1 osd.2 32 log_to_monitors true 2024-09-12T21:53:56.016 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-09-12T21:53:56.013+0000 7f2dd705a640 -1 osd.2 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T21:53:57.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T21:53:57.825 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T21:53:57.825 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-09-12T21:53:57.826 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-09-12T21:53:57.826 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T21:53:57.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T21:53:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T21:53:59.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T21:54:00.013 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T21:54:00.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T21:54:01.018 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T21:54:01.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T21:54:01.036 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:54:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:54:01.340 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:54:01.348 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T21:54:01.015484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":174,"acting":177,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3257756,"kb_used_data":2403416,"kb_used_omap":9,"kb_used_meta":854262,"kb_avail":279857764,"statfs":{"total":289910292480,"available":286574350336,"internally_reserved":0,"allocated":2461097984,"data_stored":2459829201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":874765296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-13,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630720+0000","last_change":"2024-09-12T21:51:22.309485+0000","last_active":"2024-09-12T21:52:55.630720+0000","last_peered":"2024-09-12T21:52:55.630720+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309485+0000","last_became_peered":"2024-09-12T21:51:22.309485+0000","last_unstale":"2024-09-12T21:52:55.630720+0000","last_undegraded":"2024-09-12T21:52:55.630720+0000","last_fullsized":"2024-09-12T21:51:22.306650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:40.213204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629965+0000","last_change":"2024-09-12T21:51:22.327937+0000","last_active":"2024-09-12T21:52:55.629965+0000","last_peered":"2024-09-12T21:52:55.629965+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.327937+0000","last_became_peered":"2024-09-12T21:51:22.327937+0000","last_unstale":"2024-09-12T21:52:55.629965+0000","last_undegraded":"2024-09-12T21:52:55.629965+0000","last_fullsized":"2024-09-12T21:51:22.307056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010728+0000","last_change":"2024-09-12T21:53:58.040043+0000","last_active":"2024-09-12T21:53:59.010728+0000","last_peered":"2024-09-12T21:53:59.010728+0000","last_clean":"2024-09-12T21:53:59.010728+0000","last_became_active":"2024-09-12T21:53:58.038888+0000","last_became_peered":"2024-09-12T21:53:58.038888+0000","last_unstale":"2024-09-12T21:53:59.010728+0000","last_undegraded":"2024-09-12T21:53:59.010728+0000","last_fullsized":"2024-09-12T21:53:59.010728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011185+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:53:59.011185+0000","last_peered":"2024-09-12T21:53:59.011185+0000","last_clean":"2024-09-12T21:53:59.011185+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:53:59.011185+0000","last_undegraded":"2024-09-12T21:53:59.011185+0000","last_fullsized":"2024-09-12T21:53:59.011185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629082+0000","last_change":"2024-09-12T21:51:22.308686+0000","last_active":"2024-09-12T21:52:55.629082+0000","last_peered":"2024-09-12T21:52:55.629082+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308686+0000","last_became_peered":"2024-09-12T21:51:22.308686+0000","last_unstale":"2024-09-12T21:52:55.629082+0000","last_undegraded":"2024-09-12T21:52:55.629082+0000","last_fullsized":"2024-09-12T21:51:22.305597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:11.406814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010126+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:53:59.010126+0000","last_peered":"2024-09-12T21:53:59.010126+0000","last_clean":"2024-09-12T21:53:59.010126+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:53:59.010126+0000","last_undegraded":"2024-09-12T21:53:59.010126+0000","last_fullsized":"2024-09-12T21:53:59.010126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010100+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:53:59.010100+0000","last_peered":"2024-09-12T21:53:59.010100+0000","last_clean":"2024-09-12T21:53:59.010100+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:53:59.010100+0000","last_undegraded":"2024-09-12T21:53:59.010100+0000","last_fullsized":"2024-09-12T21:53:59.010100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009911+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:53:59.009911+0000","last_peered":"2024-09-12T21:53:59.009911+0000","last_clean":"2024-09-12T21:53:59.009911+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:53:59.009911+0000","last_undegraded":"2024-09-12T21:53:59.009911+0000","last_fullsized":"2024-09-12T21:53:59.009911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010908+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:53:59.010908+0000","last_peered":"2024-09-12T21:53:59.010908+0000","last_clean":"2024-09-12T21:53:59.010908+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:53:59.010908+0000","last_undegraded":"2024-09-12T21:53:59.010908+0000","last_fullsized":"2024-09-12T21:53:59.010908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629693+0000","last_change":"2024-09-12T21:51:22.325625+0000","last_active":"2024-09-12T21:52:55.629693+0000","last_peered":"2024-09-12T21:52:55.629693+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.325625+0000","last_became_peered":"2024-09-12T21:51:22.325625+0000","last_unstale":"2024-09-12T21:52:55.629693+0000","last_undegraded":"2024-09-12T21:52:55.629693+0000","last_fullsized":"2024-09-12T21:51:22.306385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011224+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:53:59.011224+0000","last_peered":"2024-09-12T21:53:59.011224+0000","last_clean":"2024-09-12T21:53:59.011224+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:53:59.011224+0000","last_undegraded":"2024-09-12T21:53:59.011224+0000","last_fullsized":"2024-09-12T21:53:59.011224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629464+0000","last_change":"2024-09-12T21:51:22.308305+0000","last_active":"2024-09-12T21:52:55.629464+0000","last_peered":"2024-09-12T21:52:55.629464+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308305+0000","last_became_peered":"2024-09-12T21:51:22.308305+0000","last_unstale":"2024-09-12T21:52:55.629464+0000","last_undegraded":"2024-09-12T21:52:55.629464+0000","last_fullsized":"2024-09-12T21:51:22.305646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:40.213204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629988+0000","last_change":"2024-09-12T21:51:22.309352+0000","last_active":"2024-09-12T21:52:55.629988+0000","last_peered":"2024-09-12T21:52:55.629988+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309352+0000","last_became_peered":"2024-09-12T21:51:22.309352+0000","last_unstale":"2024-09-12T21:52:55.629988+0000","last_undegraded":"2024-09-12T21:52:55.629988+0000","last_fullsized":"2024-09-12T21:51:22.306258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:22.607885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010387+0000","last_change":"2024-09-12T21:53:58.041552+0000","last_active":"2024-09-12T21:53:59.010387+0000","last_peered":"2024-09-12T21:53:59.010387+0000","last_clean":"2024-09-12T21:53:59.010387+0000","last_became_active":"2024-09-12T21:53:58.040203+0000","last_became_peered":"2024-09-12T21:53:58.040203+0000","last_unstale":"2024-09-12T21:53:59.010387+0000","last_undegraded":"2024-09-12T21:53:59.010387+0000","last_fullsized":"2024-09-12T21:53:59.010387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:58.900117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010155+0000","last_change":"2024-09-12T21:53:58.041791+0000","last_active":"2024-09-12T21:53:59.010155+0000","last_peered":"2024-09-12T21:53:59.010155+0000","last_clean":"2024-09-12T21:53:59.010155+0000","last_became_active":"2024-09-12T21:53:58.041201+0000","last_became_peered":"2024-09-12T21:53:58.041201+0000","last_unstale":"2024-09-12T21:53:59.010155+0000","last_undegraded":"2024-09-12T21:53:59.010155+0000","last_fullsized":"2024-09-12T21:53:59.010155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009938+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:53:59.009938+0000","last_peered":"2024-09-12T21:53:59.009938+0000","last_clean":"2024-09-12T21:53:59.009938+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:53:59.009938+0000","last_undegraded":"2024-09-12T21:53:59.009938+0000","last_fullsized":"2024-09-12T21:53:59.009938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011156+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:53:59.011156+0000","last_peered":"2024-09-12T21:53:59.011156+0000","last_clean":"2024-09-12T21:53:59.011156+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:53:59.011156+0000","last_undegraded":"2024-09-12T21:53:59.011156+0000","last_fullsized":"2024-09-12T21:53:59.011156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630438+0000","last_change":"2024-09-12T21:51:22.328021+0000","last_active":"2024-09-12T21:52:55.630438+0000","last_peered":"2024-09-12T21:52:55.630438+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.328021+0000","last_became_peered":"2024-09-12T21:51:22.328021+0000","last_unstale":"2024-09-12T21:52:55.630438+0000","last_undegraded":"2024-09-12T21:52:55.630438+0000","last_fullsized":"2024-09-12T21:51:22.307876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:33.926870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010446+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:53:59.010446+0000","last_peered":"2024-09-12T21:53:59.010446+0000","last_clean":"2024-09-12T21:53:59.010446+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:53:59.010446+0000","last_undegraded":"2024-09-12T21:53:59.010446+0000","last_fullsized":"2024-09-12T21:53:59.010446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010481+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:53:59.010481+0000","last_peered":"2024-09-12T21:53:59.010481+0000","last_clean":"2024-09-12T21:53:59.010481+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:53:59.010481+0000","last_undegraded":"2024-09-12T21:53:59.010481+0000","last_fullsized":"2024-09-12T21:53:59.010481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010459+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:53:59.010459+0000","last_peered":"2024-09-12T21:53:59.010459+0000","last_clean":"2024-09-12T21:53:59.010459+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:53:59.010459+0000","last_undegraded":"2024-09-12T21:53:59.010459+0000","last_fullsized":"2024-09-12T21:53:59.010459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630336+0000","last_change":"2024-09-12T21:51:22.309302+0000","last_active":"2024-09-12T21:52:55.630336+0000","last_peered":"2024-09-12T21:52:55.630336+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309302+0000","last_became_peered":"2024-09-12T21:51:22.309302+0000","last_unstale":"2024-09-12T21:52:55.630336+0000","last_undegraded":"2024-09-12T21:52:55.630336+0000","last_fullsized":"2024-09-12T21:51:22.305877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.391366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009612+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:53:59.009612+0000","last_peered":"2024-09-12T21:53:59.009612+0000","last_clean":"2024-09-12T21:53:59.009612+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:53:59.009612+0000","last_undegraded":"2024-09-12T21:53:59.009612+0000","last_fullsized":"2024-09-12T21:53:59.009612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628688+0000","last_change":"2024-09-12T21:51:22.317902+0000","last_active":"2024-09-12T21:52:55.628688+0000","last_peered":"2024-09-12T21:52:55.628688+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.317902+0000","last_became_peered":"2024-09-12T21:51:22.317902+0000","last_unstale":"2024-09-12T21:52:55.628688+0000","last_undegraded":"2024-09-12T21:52:55.628688+0000","last_fullsized":"2024-09-12T21:51:22.305232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:31.525706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630620+0000","last_change":"2024-09-12T21:51:22.318217+0000","last_active":"2024-09-12T21:52:55.630620+0000","last_peered":"2024-09-12T21:52:55.630620+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.318217+0000","last_became_peered":"2024-09-12T21:51:22.318217+0000","last_unstale":"2024-09-12T21:52:55.630620+0000","last_undegraded":"2024-09-12T21:52:55.630620+0000","last_fullsized":"2024-09-12T21:51:22.308047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.469001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010809+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:53:59.010809+0000","last_peered":"2024-09-12T21:53:59.010809+0000","last_clean":"2024-09-12T21:53:59.010809+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:53:59.010809+0000","last_undegraded":"2024-09-12T21:53:59.010809+0000","last_fullsized":"2024-09-12T21:53:59.010809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011237+0000","last_change":"2024-09-12T21:53:58.040332+0000","last_active":"2024-09-12T21:53:59.011237+0000","last_peered":"2024-09-12T21:53:59.011237+0000","last_clean":"2024-09-12T21:53:59.011237+0000","last_became_active":"2024-09-12T21:53:58.038996+0000","last_became_peered":"2024-09-12T21:53:58.038996+0000","last_unstale":"2024-09-12T21:53:59.011237+0000","last_undegraded":"2024-09-12T21:53:59.011237+0000","last_fullsized":"2024-09-12T21:53:59.011237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629478+0000","last_change":"2024-09-12T21:51:22.309042+0000","last_active":"2024-09-12T21:52:55.629478+0000","last_peered":"2024-09-12T21:52:55.629478+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309042+0000","last_became_peered":"2024-09-12T21:51:22.309042+0000","last_unstale":"2024-09-12T21:52:55.629478+0000","last_undegraded":"2024-09-12T21:52:55.629478+0000","last_fullsized":"2024-09-12T21:51:22.305608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.304115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010438+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:53:59.010438+0000","last_peered":"2024-09-12T21:53:59.010438+0000","last_clean":"2024-09-12T21:53:59.010438+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:53:59.010438+0000","last_undegraded":"2024-09-12T21:53:59.010438+0000","last_fullsized":"2024-09-12T21:53:59.010438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629168+0000","last_change":"2024-09-12T21:51:22.309094+0000","last_active":"2024-09-12T21:52:55.629168+0000","last_peered":"2024-09-12T21:52:55.629168+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309094+0000","last_became_peered":"2024-09-12T21:51:22.309094+0000","last_unstale":"2024-09-12T21:52:55.629168+0000","last_undegraded":"2024-09-12T21:52:55.629168+0000","last_fullsized":"2024-09-12T21:51:22.305342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:11.233523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009667+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:53:59.009667+0000","last_peered":"2024-09-12T21:53:59.009667+0000","last_clean":"2024-09-12T21:53:59.009667+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:53:59.009667+0000","last_undegraded":"2024-09-12T21:53:59.009667+0000","last_fullsized":"2024-09-12T21:53:59.009667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010063+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:53:59.010063+0000","last_peered":"2024-09-12T21:53:59.010063+0000","last_clean":"2024-09-12T21:53:59.010063+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:53:59.010063+0000","last_undegraded":"2024-09-12T21:53:59.010063+0000","last_fullsized":"2024-09-12T21:53:59.010063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629569+0000","last_change":"2024-09-12T21:51:22.309367+0000","last_active":"2024-09-12T21:52:55.629569+0000","last_peered":"2024-09-12T21:52:55.629569+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309367+0000","last_became_peered":"2024-09-12T21:51:22.309367+0000","last_unstale":"2024-09-12T21:52:55.629569+0000","last_undegraded":"2024-09-12T21:52:55.629569+0000","last_fullsized":"2024-09-12T21:51:22.305699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:20.692923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010837+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:53:59.010837+0000","last_peered":"2024-09-12T21:53:59.010837+0000","last_clean":"2024-09-12T21:53:59.010837+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:53:59.010837+0000","last_undegraded":"2024-09-12T21:53:59.010837+0000","last_fullsized":"2024-09-12T21:53:59.010837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629806+0000","last_change":"2024-09-12T21:51:22.309051+0000","last_active":"2024-09-12T21:52:55.629806+0000","last_peered":"2024-09-12T21:52:55.629806+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309051+0000","last_became_peered":"2024-09-12T21:51:22.309051+0000","last_unstale":"2024-09-12T21:52:55.629806+0000","last_undegraded":"2024-09-12T21:52:55.629806+0000","last_fullsized":"2024-09-12T21:51:22.306134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:16.283740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.630564+0000","last_change":"2024-09-12T21:51:24.427714+0000","last_active":"2024-09-12T21:52:55.630564+0000","last_peered":"2024-09-12T21:52:55.630564+0000","last_clean":"2024-09-12T21:52:55.630564+0000","last_became_active":"2024-09-12T21:51:24.427318+0000","last_became_peered":"2024-09-12T21:51:24.427318+0000","last_unstale":"2024-09-12T21:52:55.630564+0000","last_undegraded":"2024-09-12T21:52:55.630564+0000","last_fullsized":"2024-09-12T21:52:55.630564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:09.128038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011024+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:53:59.011024+0000","last_peered":"2024-09-12T21:53:59.011024+0000","last_clean":"2024-09-12T21:53:59.011024+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:53:59.011024+0000","last_undegraded":"2024-09-12T21:53:59.011024+0000","last_fullsized":"2024-09-12T21:53:59.011024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629363+0000","last_change":"2024-09-12T21:51:22.311373+0000","last_active":"2024-09-12T21:52:55.629363+0000","last_peered":"2024-09-12T21:52:55.629363+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.311373+0000","last_became_peered":"2024-09-12T21:51:22.311373+0000","last_unstale":"2024-09-12T21:52:55.629363+0000","last_undegraded":"2024-09-12T21:52:55.629363+0000","last_fullsized":"2024-09-12T21:51:22.306140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:30.521850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010608+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:53:59.010608+0000","last_peered":"2024-09-12T21:53:59.010608+0000","last_clean":"2024-09-12T21:53:59.010608+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:53:59.010608+0000","last_undegraded":"2024-09-12T21:53:59.010608+0000","last_fullsized":"2024-09-12T21:53:59.010608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010073+0000","last_change":"2024-09-12T21:53:58.042708+0000","last_active":"2024-09-12T21:53:59.010073+0000","last_peered":"2024-09-12T21:53:59.010073+0000","last_clean":"2024-09-12T21:53:59.010073+0000","last_became_active":"2024-09-12T21:53:58.041891+0000","last_became_peered":"2024-09-12T21:53:58.041891+0000","last_unstale":"2024-09-12T21:53:59.010073+0000","last_undegraded":"2024-09-12T21:53:59.010073+0000","last_fullsized":"2024-09-12T21:53:59.010073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011089+0000","last_change":"2024-09-12T21:53:58.042420+0000","last_active":"2024-09-12T21:53:59.011089+0000","last_peered":"2024-09-12T21:53:59.011089+0000","last_clean":"2024-09-12T21:53:59.011089+0000","last_became_active":"2024-09-12T21:53:58.040977+0000","last_became_peered":"2024-09-12T21:53:58.040977+0000","last_unstale":"2024-09-12T21:53:59.011089+0000","last_undegraded":"2024-09-12T21:53:59.011089+0000","last_fullsized":"2024-09-12T21:53:59.011089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628895+0000","last_change":"2024-09-12T21:51:22.307218+0000","last_active":"2024-09-12T21:52:55.628895+0000","last_peered":"2024-09-12T21:52:55.628895+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.307218+0000","last_became_peered":"2024-09-12T21:51:22.307218+0000","last_unstale":"2024-09-12T21:52:55.628895+0000","last_undegraded":"2024-09-12T21:52:55.628895+0000","last_fullsized":"2024-09-12T21:51:22.305215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:51.049086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.630115+0000","last_change":"2024-09-12T21:51:22.309034+0000","last_active":"2024-09-12T21:52:55.630115+0000","last_peered":"2024-09-12T21:52:55.630115+0000","last_clean":"2024-09-12T21:50:39.844868+0000","last_became_active":"2024-09-12T21:51:22.309034+0000","last_became_peered":"2024-09-12T21:51:22.309034+0000","last_unstale":"2024-09-12T21:52:55.630115+0000","last_undegraded":"2024-09-12T21:51:22.307075+0000","last_fullsized":"2024-09-12T21:51:22.306997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629018+0000","last_change":"2024-09-12T21:51:22.308150+0000","last_active":"2024-09-12T21:52:55.629018+0000","last_peered":"2024-09-12T21:52:55.629018+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308150+0000","last_became_peered":"2024-09-12T21:51:22.308150+0000","last_unstale":"2024-09-12T21:52:55.629018+0000","last_undegraded":"2024-09-12T21:52:55.629018+0000","last_fullsized":"2024-09-12T21:51:22.305398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:14.373363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011490+0000","last_change":"2024-09-12T21:53:58.041477+0000","last_active":"2024-09-12T21:53:59.011490+0000","last_peered":"2024-09-12T21:53:59.011490+0000","last_clean":"2024-09-12T21:53:59.011490+0000","last_became_active":"2024-09-12T21:53:58.040138+0000","last_became_peered":"2024-09-12T21:53:58.040138+0000","last_unstale":"2024-09-12T21:53:59.011490+0000","last_undegraded":"2024-09-12T21:53:59.011490+0000","last_fullsized":"2024-09-12T21:53:59.011490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:22.389857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010664+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:53:59.010664+0000","last_peered":"2024-09-12T21:53:59.010664+0000","last_clean":"2024-09-12T21:53:59.010664+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:53:59.010664+0000","last_undegraded":"2024-09-12T21:53:59.010664+0000","last_fullsized":"2024-09-12T21:53:59.010664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.630196+0000","last_change":"2024-09-12T21:51:24.415653+0000","last_active":"2024-09-12T21:52:55.630196+0000","last_peered":"2024-09-12T21:52:55.630196+0000","last_clean":"2024-09-12T21:52:55.630196+0000","last_became_active":"2024-09-12T21:51:24.415275+0000","last_became_peered":"2024-09-12T21:51:24.415275+0000","last_unstale":"2024-09-12T21:52:55.630196+0000","last_undegraded":"2024-09-12T21:52:55.630196+0000","last_fullsized":"2024-09-12T21:52:55.630196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:47.465146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010720+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:53:59.010720+0000","last_peered":"2024-09-12T21:53:59.010720+0000","last_clean":"2024-09-12T21:53:59.010720+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:53:59.010720+0000","last_undegraded":"2024-09-12T21:53:59.010720+0000","last_fullsized":"2024-09-12T21:53:59.010720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010750+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:53:59.010750+0000","last_peered":"2024-09-12T21:53:59.010750+0000","last_clean":"2024-09-12T21:53:59.010750+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:53:59.010750+0000","last_undegraded":"2024-09-12T21:53:59.010750+0000","last_fullsized":"2024-09-12T21:53:59.010750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010587+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:53:59.010587+0000","last_peered":"2024-09-12T21:53:59.010587+0000","last_clean":"2024-09-12T21:53:59.010587+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:53:59.010587+0000","last_undegraded":"2024-09-12T21:53:59.010587+0000","last_fullsized":"2024-09-12T21:53:59.010587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010738+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:53:59.010738+0000","last_peered":"2024-09-12T21:53:59.010738+0000","last_clean":"2024-09-12T21:53:59.010738+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:53:59.010738+0000","last_undegraded":"2024-09-12T21:53:59.010738+0000","last_fullsized":"2024-09-12T21:53:59.010738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011370+0000","last_change":"2024-09-12T21:53:58.040759+0000","last_active":"2024-09-12T21:53:59.011370+0000","last_peered":"2024-09-12T21:53:59.011370+0000","last_clean":"2024-09-12T21:53:59.011370+0000","last_became_active":"2024-09-12T21:53:58.039636+0000","last_became_peered":"2024-09-12T21:53:58.039636+0000","last_unstale":"2024-09-12T21:53:59.011370+0000","last_undegraded":"2024-09-12T21:53:59.011370+0000","last_fullsized":"2024-09-12T21:53:59.011370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629058+0000","last_change":"2024-09-12T21:51:22.310964+0000","last_active":"2024-09-12T21:52:55.629058+0000","last_peered":"2024-09-12T21:52:55.629058+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.310964+0000","last_became_peered":"2024-09-12T21:51:22.310964+0000","last_unstale":"2024-09-12T21:52:55.629058+0000","last_undegraded":"2024-09-12T21:52:55.629058+0000","last_fullsized":"2024-09-12T21:51:22.305639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:22.284406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010920+0000","last_change":"2024-09-12T21:53:58.041801+0000","last_active":"2024-09-12T21:53:59.010920+0000","last_peered":"2024-09-12T21:53:59.010920+0000","last_clean":"2024-09-12T21:53:59.010920+0000","last_became_active":"2024-09-12T21:53:58.041203+0000","last_became_peered":"2024-09-12T21:53:58.041203+0000","last_unstale":"2024-09-12T21:53:59.010920+0000","last_undegraded":"2024-09-12T21:53:59.010920+0000","last_fullsized":"2024-09-12T21:53:59.010920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628977+0000","last_change":"2024-09-12T21:51:22.320670+0000","last_active":"2024-09-12T21:52:55.628977+0000","last_peered":"2024-09-12T21:52:55.628977+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.320670+0000","last_became_peered":"2024-09-12T21:51:22.320670+0000","last_unstale":"2024-09-12T21:52:55.628977+0000","last_undegraded":"2024-09-12T21:52:55.628977+0000","last_fullsized":"2024-09-12T21:51:22.305552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:24.241327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010796+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:53:59.010796+0000","last_peered":"2024-09-12T21:53:59.010796+0000","last_clean":"2024-09-12T21:53:59.010796+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:53:59.010796+0000","last_undegraded":"2024-09-12T21:53:59.010796+0000","last_fullsized":"2024-09-12T21:53:59.010796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":342,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010325+0000","last_change":"2024-09-12T21:53:58.043230+0000","last_active":"2024-09-12T21:53:59.010325+0000","last_peered":"2024-09-12T21:53:59.010325+0000","last_clean":"2024-09-12T21:53:59.010325+0000","last_became_active":"2024-09-12T21:53:58.042758+0000","last_became_peered":"2024-09-12T21:53:58.042758+0000","last_unstale":"2024-09-12T21:53:59.010325+0000","last_undegraded":"2024-09-12T21:53:59.010325+0000","last_fullsized":"2024-09-12T21:53:59.010325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:24.578612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":151,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.018078+0000","last_change":"2024-09-12T21:53:59.018078+0000","last_active":"2024-09-12T21:53:59.018078+0000","last_peered":"2024-09-12T21:53:59.018078+0000","last_clean":"2024-09-12T21:53:59.018078+0000","last_became_active":"2024-09-12T21:53:59.014336+0000","last_became_peered":"2024-09-12T21:53:59.014336+0000","last_unstale":"2024-09-12T21:53:59.018078+0000","last_undegraded":"2024-09-12T21:53:59.018078+0000","last_fullsized":"2024-09-12T21:53:59.018078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:27.734206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010111+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:53:59.010111+0000","last_peered":"2024-09-12T21:53:59.010111+0000","last_clean":"2024-09-12T21:53:59.010111+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:53:59.010111+0000","last_undegraded":"2024-09-12T21:53:59.010111+0000","last_fullsized":"2024-09-12T21:53:59.010111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011417+0000","last_change":"2024-09-12T21:53:58.040621+0000","last_active":"2024-09-12T21:53:59.011417+0000","last_peered":"2024-09-12T21:53:59.011417+0000","last_clean":"2024-09-12T21:53:59.011417+0000","last_became_active":"2024-09-12T21:53:58.039604+0000","last_became_peered":"2024-09-12T21:53:58.039604+0000","last_unstale":"2024-09-12T21:53:59.011417+0000","last_undegraded":"2024-09-12T21:53:59.011417+0000","last_fullsized":"2024-09-12T21:53:59.011417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010224+0000","last_change":"2024-09-12T21:53:58.042035+0000","last_active":"2024-09-12T21:53:59.010224+0000","last_peered":"2024-09-12T21:53:59.010224+0000","last_clean":"2024-09-12T21:53:59.010224+0000","last_became_active":"2024-09-12T21:53:58.040375+0000","last_became_peered":"2024-09-12T21:53:58.040375+0000","last_unstale":"2024-09-12T21:53:59.010224+0000","last_undegraded":"2024-09-12T21:53:59.010224+0000","last_fullsized":"2024-09-12T21:53:59.010224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:41.072643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.014497+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:53:59.014497+0000","last_peered":"2024-09-12T21:53:59.014497+0000","last_clean":"2024-09-12T21:53:59.014497+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:53:59.014497+0000","last_undegraded":"2024-09-12T21:53:59.014497+0000","last_fullsized":"2024-09-12T21:53:59.014497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629780+0000","last_change":"2024-09-12T21:51:22.327773+0000","last_active":"2024-09-12T21:52:55.629780+0000","last_peered":"2024-09-12T21:52:55.629780+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.327773+0000","last_became_peered":"2024-09-12T21:51:22.327773+0000","last_unstale":"2024-09-12T21:52:55.629780+0000","last_undegraded":"2024-09-12T21:52:55.629780+0000","last_fullsized":"2024-09-12T21:51:22.306512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:02.325480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010311+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:53:59.010311+0000","last_peered":"2024-09-12T21:53:59.010311+0000","last_clean":"2024-09-12T21:53:59.010311+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:53:59.010311+0000","last_undegraded":"2024-09-12T21:53:59.010311+0000","last_fullsized":"2024-09-12T21:53:59.010311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628964+0000","last_change":"2024-09-12T21:51:22.308260+0000","last_active":"2024-09-12T21:52:55.628964+0000","last_peered":"2024-09-12T21:52:55.628964+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.308260+0000","last_became_peered":"2024-09-12T21:51:22.308260+0000","last_unstale":"2024-09-12T21:52:55.628964+0000","last_undegraded":"2024-09-12T21:52:55.628964+0000","last_fullsized":"2024-09-12T21:51:22.305290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:22.300810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010992+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:53:59.010992+0000","last_peered":"2024-09-12T21:53:59.010992+0000","last_clean":"2024-09-12T21:53:59.010992+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:53:59.010992+0000","last_undegraded":"2024-09-12T21:53:59.010992+0000","last_fullsized":"2024-09-12T21:53:59.010992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010889+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:53:59.010889+0000","last_peered":"2024-09-12T21:53:59.010889+0000","last_clean":"2024-09-12T21:53:59.010889+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:53:59.010889+0000","last_undegraded":"2024-09-12T21:53:59.010889+0000","last_fullsized":"2024-09-12T21:53:59.010889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010938+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:53:59.010938+0000","last_peered":"2024-09-12T21:53:59.010938+0000","last_clean":"2024-09-12T21:53:59.010938+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:53:59.010938+0000","last_undegraded":"2024-09-12T21:53:59.010938+0000","last_fullsized":"2024-09-12T21:53:59.010938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010642+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:53:59.010642+0000","last_peered":"2024-09-12T21:53:59.010642+0000","last_clean":"2024-09-12T21:53:59.010642+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:53:59.010642+0000","last_undegraded":"2024-09-12T21:53:59.010642+0000","last_fullsized":"2024-09-12T21:53:59.010642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011507+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:53:59.011507+0000","last_peered":"2024-09-12T21:53:59.011507+0000","last_clean":"2024-09-12T21:53:59.011507+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:53:59.011507+0000","last_undegraded":"2024-09-12T21:53:59.011507+0000","last_fullsized":"2024-09-12T21:53:59.011507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010822+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:53:59.010822+0000","last_peered":"2024-09-12T21:53:59.010822+0000","last_clean":"2024-09-12T21:53:59.010822+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:53:59.010822+0000","last_undegraded":"2024-09-12T21:53:59.010822+0000","last_fullsized":"2024-09-12T21:53:59.010822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629199+0000","last_change":"2024-09-12T21:51:22.308555+0000","last_active":"2024-09-12T21:52:55.629199+0000","last_peered":"2024-09-12T21:52:55.629199+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308555+0000","last_became_peered":"2024-09-12T21:51:22.308555+0000","last_unstale":"2024-09-12T21:52:55.629199+0000","last_undegraded":"2024-09-12T21:52:55.629199+0000","last_fullsized":"2024-09-12T21:51:22.305522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:34.264392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010754+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:53:59.010754+0000","last_peered":"2024-09-12T21:53:59.010754+0000","last_clean":"2024-09-12T21:53:59.010754+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:53:59.010754+0000","last_undegraded":"2024-09-12T21:53:59.010754+0000","last_fullsized":"2024-09-12T21:53:59.010754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630198+0000","last_change":"2024-09-12T21:51:22.309235+0000","last_active":"2024-09-12T21:52:55.630198+0000","last_peered":"2024-09-12T21:52:55.630198+0000","last_clean":"2024-09-12T21:50:33.704973+0000","last_became_active":"2024-09-12T21:51:22.309235+0000","last_became_peered":"2024-09-12T21:51:22.309235+0000","last_unstale":"2024-09-12T21:52:55.630198+0000","last_undegraded":"2024-09-12T21:52:55.630198+0000","last_fullsized":"2024-09-12T21:51:22.306888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:09.811005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629499+0000","last_change":"2024-09-12T21:51:22.308344+0000","last_active":"2024-09-12T21:52:55.629499+0000","last_peered":"2024-09-12T21:52:55.629499+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308344+0000","last_became_peered":"2024-09-12T21:51:22.308344+0000","last_unstale":"2024-09-12T21:52:55.629499+0000","last_undegraded":"2024-09-12T21:52:55.629499+0000","last_fullsized":"2024-09-12T21:51:22.305545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:20.692923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011227+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:53:59.011227+0000","last_peered":"2024-09-12T21:53:59.011227+0000","last_clean":"2024-09-12T21:53:59.011227+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:53:59.011227+0000","last_undegraded":"2024-09-12T21:53:59.011227+0000","last_fullsized":"2024-09-12T21:53:59.011227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011152+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:53:59.011152+0000","last_peered":"2024-09-12T21:53:59.011152+0000","last_clean":"2024-09-12T21:53:59.011152+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:53:59.011152+0000","last_undegraded":"2024-09-12T21:53:59.011152+0000","last_fullsized":"2024-09-12T21:53:59.011152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009827+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:53:59.009827+0000","last_peered":"2024-09-12T21:53:59.009827+0000","last_clean":"2024-09-12T21:53:59.009827+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:53:59.009827+0000","last_undegraded":"2024-09-12T21:53:59.009827+0000","last_fullsized":"2024-09-12T21:53:59.009827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.016410+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:53:59.016410+0000","last_peered":"2024-09-12T21:53:59.016410+0000","last_clean":"2024-09-12T21:53:59.016410+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:53:59.016410+0000","last_undegraded":"2024-09-12T21:53:59.016410+0000","last_fullsized":"2024-09-12T21:53:59.016410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011113+0000","last_change":"2024-09-12T21:53:58.041233+0000","last_active":"2024-09-12T21:53:59.011113+0000","last_peered":"2024-09-12T21:53:59.011113+0000","last_clean":"2024-09-12T21:53:59.011113+0000","last_became_active":"2024-09-12T21:53:58.040031+0000","last_became_peered":"2024-09-12T21:53:58.040031+0000","last_unstale":"2024-09-12T21:53:59.011113+0000","last_undegraded":"2024-09-12T21:53:59.011113+0000","last_fullsized":"2024-09-12T21:53:59.011113+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629096+0000","last_change":"2024-09-12T21:51:22.311192+0000","last_active":"2024-09-12T21:52:55.629096+0000","last_peered":"2024-09-12T21:52:55.629096+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.311192+0000","last_became_peered":"2024-09-12T21:51:22.311192+0000","last_unstale":"2024-09-12T21:52:55.629096+0000","last_undegraded":"2024-09-12T21:52:55.629096+0000","last_fullsized":"2024-09-12T21:51:22.305993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:12.528560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010919+0000","last_change":"2024-09-12T21:53:58.041883+0000","last_active":"2024-09-12T21:53:59.010919+0000","last_peered":"2024-09-12T21:53:59.010919+0000","last_clean":"2024-09-12T21:53:59.010919+0000","last_became_active":"2024-09-12T21:53:58.040846+0000","last_became_peered":"2024-09-12T21:53:58.040846+0000","last_unstale":"2024-09-12T21:53:59.010919+0000","last_undegraded":"2024-09-12T21:53:59.010919+0000","last_fullsized":"2024-09-12T21:53:59.010919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.102109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010922+0000","last_change":"2024-09-12T21:53:58.044236+0000","last_active":"2024-09-12T21:53:59.010922+0000","last_peered":"2024-09-12T21:53:59.010922+0000","last_clean":"2024-09-12T21:53:59.010922+0000","last_became_active":"2024-09-12T21:53:58.043963+0000","last_became_peered":"2024-09-12T21:53:58.043963+0000","last_unstale":"2024-09-12T21:53:59.010922+0000","last_undegraded":"2024-09-12T21:53:59.010922+0000","last_fullsized":"2024-09-12T21:53:59.010922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:08.668730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009800+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:53:59.009800+0000","last_peered":"2024-09-12T21:53:59.009800+0000","last_clean":"2024-09-12T21:53:59.009800+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:53:59.009800+0000","last_undegraded":"2024-09-12T21:53:59.009800+0000","last_fullsized":"2024-09-12T21:53:59.009800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.630743+0000","last_change":"2024-09-12T21:51:22.313739+0000","last_active":"2024-09-12T21:52:55.630743+0000","last_peered":"2024-09-12T21:52:55.630743+0000","last_clean":"2024-09-12T21:50:39.844215+0000","last_became_active":"2024-09-12T21:51:22.313739+0000","last_became_peered":"2024-09-12T21:51:22.313739+0000","last_unstale":"2024-09-12T21:52:55.630743+0000","last_undegraded":"2024-09-12T21:51:22.307384+0000","last_fullsized":"2024-09-12T21:51:22.307313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011216+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:53:59.011216+0000","last_peered":"2024-09-12T21:53:59.011216+0000","last_clean":"2024-09-12T21:53:59.011216+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:53:59.011216+0000","last_undegraded":"2024-09-12T21:53:59.011216+0000","last_fullsized":"2024-09-12T21:53:59.011216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009744+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:53:59.009744+0000","last_peered":"2024-09-12T21:53:59.009744+0000","last_clean":"2024-09-12T21:53:59.009744+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:53:59.009744+0000","last_undegraded":"2024-09-12T21:53:59.009744+0000","last_fullsized":"2024-09-12T21:53:59.009744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011152+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:53:59.011152+0000","last_peered":"2024-09-12T21:53:59.011152+0000","last_clean":"2024-09-12T21:53:59.011152+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:53:59.011152+0000","last_undegraded":"2024-09-12T21:53:59.011152+0000","last_fullsized":"2024-09-12T21:53:59.011152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009795+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:53:59.009795+0000","last_peered":"2024-09-12T21:53:59.009795+0000","last_clean":"2024-09-12T21:53:59.009795+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:53:59.009795+0000","last_undegraded":"2024-09-12T21:53:59.009795+0000","last_fullsized":"2024-09-12T21:53:59.009795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630497+0000","last_change":"2024-09-12T21:51:22.310418+0000","last_active":"2024-09-12T21:52:55.630497+0000","last_peered":"2024-09-12T21:52:55.630497+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.310418+0000","last_became_peered":"2024-09-12T21:51:22.310418+0000","last_unstale":"2024-09-12T21:52:55.630497+0000","last_undegraded":"2024-09-12T21:52:55.630497+0000","last_fullsized":"2024-09-12T21:51:22.307973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:16.096308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010063+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:53:59.010063+0000","last_peered":"2024-09-12T21:53:59.010063+0000","last_clean":"2024-09-12T21:53:59.010063+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:53:59.010063+0000","last_undegraded":"2024-09-12T21:53:59.010063+0000","last_fullsized":"2024-09-12T21:53:59.010063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010834+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:53:59.010834+0000","last_peered":"2024-09-12T21:53:59.010834+0000","last_clean":"2024-09-12T21:53:59.010834+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:53:59.010834+0000","last_undegraded":"2024-09-12T21:53:59.010834+0000","last_fullsized":"2024-09-12T21:53:59.010834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009896+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:53:59.009896+0000","last_peered":"2024-09-12T21:53:59.009896+0000","last_clean":"2024-09-12T21:53:59.009896+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:53:59.009896+0000","last_undegraded":"2024-09-12T21:53:59.009896+0000","last_fullsized":"2024-09-12T21:53:59.009896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629566+0000","last_change":"2024-09-12T21:51:22.309903+0000","last_active":"2024-09-12T21:52:55.629566+0000","last_peered":"2024-09-12T21:52:55.629566+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309903+0000","last_became_peered":"2024-09-12T21:51:22.309903+0000","last_unstale":"2024-09-12T21:52:55.629566+0000","last_undegraded":"2024-09-12T21:52:55.629566+0000","last_fullsized":"2024-09-12T21:51:22.306320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628821+0000","last_change":"2024-09-12T21:51:22.318300+0000","last_active":"2024-09-12T21:52:55.628821+0000","last_peered":"2024-09-12T21:52:55.628821+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.318300+0000","last_became_peered":"2024-09-12T21:51:22.318300+0000","last_unstale":"2024-09-12T21:52:55.628821+0000","last_undegraded":"2024-09-12T21:52:55.628821+0000","last_fullsized":"2024-09-12T21:51:22.305296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:22.284406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629948+0000","last_change":"2024-09-12T21:51:22.309290+0000","last_active":"2024-09-12T21:52:55.629948+0000","last_peered":"2024-09-12T21:52:55.629948+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309290+0000","last_became_peered":"2024-09-12T21:51:22.309290+0000","last_unstale":"2024-09-12T21:52:55.629948+0000","last_undegraded":"2024-09-12T21:52:55.629948+0000","last_fullsized":"2024-09-12T21:51:22.306804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:10.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":78,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.628871+0000","last_change":"2024-09-12T21:51:24.415349+0000","last_active":"2024-09-12T21:52:55.628871+0000","last_peered":"2024-09-12T21:52:55.628871+0000","last_clean":"2024-09-12T21:52:55.628871+0000","last_became_active":"2024-09-12T21:51:24.414817+0000","last_became_peered":"2024-09-12T21:51:24.414817+0000","last_unstale":"2024-09-12T21:52:55.628871+0000","last_undegraded":"2024-09-12T21:52:55.628871+0000","last_fullsized":"2024-09-12T21:52:55.628871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:46.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010689+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:53:59.010689+0000","last_peered":"2024-09-12T21:53:59.010689+0000","last_clean":"2024-09-12T21:53:59.010689+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:53:59.010689+0000","last_undegraded":"2024-09-12T21:53:59.010689+0000","last_fullsized":"2024-09-12T21:53:59.010689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010796+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:53:59.010796+0000","last_peered":"2024-09-12T21:53:59.010796+0000","last_clean":"2024-09-12T21:53:59.010796+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:53:59.010796+0000","last_undegraded":"2024-09-12T21:53:59.010796+0000","last_fullsized":"2024-09-12T21:53:59.010796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010542+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:53:59.010542+0000","last_peered":"2024-09-12T21:53:59.010542+0000","last_clean":"2024-09-12T21:53:59.010542+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:53:59.010542+0000","last_undegraded":"2024-09-12T21:53:59.010542+0000","last_fullsized":"2024-09-12T21:53:59.010542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.629605+0000","last_change":"2024-09-12T21:51:22.313497+0000","last_active":"2024-09-12T21:52:55.629605+0000","last_peered":"2024-09-12T21:52:55.629605+0000","last_clean":"2024-09-12T21:50:39.844156+0000","last_became_active":"2024-09-12T21:51:22.313497+0000","last_became_peered":"2024-09-12T21:51:22.313497+0000","last_unstale":"2024-09-12T21:52:55.629605+0000","last_undegraded":"2024-09-12T21:51:22.307140+0000","last_fullsized":"2024-09-12T21:51:22.307069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:56.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629234+0000","last_change":"2024-09-12T21:51:22.309192+0000","last_active":"2024-09-12T21:52:55.629234+0000","last_peered":"2024-09-12T21:52:55.629234+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309192+0000","last_became_peered":"2024-09-12T21:51:22.309192+0000","last_unstale":"2024-09-12T21:52:55.629234+0000","last_undegraded":"2024-09-12T21:52:55.629234+0000","last_fullsized":"2024-09-12T21:51:22.305735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.209598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010986+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:53:59.010986+0000","last_peered":"2024-09-12T21:53:59.010986+0000","last_clean":"2024-09-12T21:53:59.010986+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:53:59.010986+0000","last_undegraded":"2024-09-12T21:53:59.010986+0000","last_fullsized":"2024-09-12T21:53:59.010986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010204+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:53:59.010204+0000","last_peered":"2024-09-12T21:53:59.010204+0000","last_clean":"2024-09-12T21:53:59.010204+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:53:59.010204+0000","last_undegraded":"2024-09-12T21:53:59.010204+0000","last_fullsized":"2024-09-12T21:53:59.010204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":129,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011032+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:53:59.011032+0000","last_peered":"2024-09-12T21:53:59.011032+0000","last_clean":"2024-09-12T21:53:59.011032+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:53:59.011032+0000","last_undegraded":"2024-09-12T21:53:59.011032+0000","last_fullsized":"2024-09-12T21:53:59.011032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":53,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2436516,"kb_used_data":2401172,"kb_used_omap":5,"kb_used_meta":35322,"kb_avail":91935324,"statfs":{"total":96636764160,"available":94141771776,"internally_reserved":0,"allocated":2458800128,"data_stored":2458573591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":36169830},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437392,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934448,"statfs":{"total":96636764160,"available":96188874752,"internally_reserved":0,"allocated":839680,"data_stored":331724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383848,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":382398,"kb_avail":93987992,"statfs":{"total":96636764160,"available":96243703808,"internally_reserved":0,"allocated":1458176,"data_stored":923886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391576005},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:54:01.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:54:01.683 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:54:01.684 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:54:01.693 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T21:54:01.015484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":174,"acting":177,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3257756,"kb_used_data":2403416,"kb_used_omap":9,"kb_used_meta":854262,"kb_avail":279857764,"statfs":{"total":289910292480,"available":286574350336,"internally_reserved":0,"allocated":2461097984,"data_stored":2459829201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":874765296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-13,"num_objects_misplaced":-2,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630720+0000","last_change":"2024-09-12T21:51:22.309485+0000","last_active":"2024-09-12T21:52:55.630720+0000","last_peered":"2024-09-12T21:52:55.630720+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309485+0000","last_became_peered":"2024-09-12T21:51:22.309485+0000","last_unstale":"2024-09-12T21:52:55.630720+0000","last_undegraded":"2024-09-12T21:52:55.630720+0000","last_fullsized":"2024-09-12T21:51:22.306650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:40.213204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629965+0000","last_change":"2024-09-12T21:51:22.327937+0000","last_active":"2024-09-12T21:52:55.629965+0000","last_peered":"2024-09-12T21:52:55.629965+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.327937+0000","last_became_peered":"2024-09-12T21:51:22.327937+0000","last_unstale":"2024-09-12T21:52:55.629965+0000","last_undegraded":"2024-09-12T21:52:55.629965+0000","last_fullsized":"2024-09-12T21:51:22.307056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010728+0000","last_change":"2024-09-12T21:53:58.040043+0000","last_active":"2024-09-12T21:53:59.010728+0000","last_peered":"2024-09-12T21:53:59.010728+0000","last_clean":"2024-09-12T21:53:59.010728+0000","last_became_active":"2024-09-12T21:53:58.038888+0000","last_became_peered":"2024-09-12T21:53:58.038888+0000","last_unstale":"2024-09-12T21:53:59.010728+0000","last_undegraded":"2024-09-12T21:53:59.010728+0000","last_fullsized":"2024-09-12T21:53:59.010728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011185+0000","last_change":"2024-09-12T21:50:39.855731+0000","last_active":"2024-09-12T21:53:59.011185+0000","last_peered":"2024-09-12T21:53:59.011185+0000","last_clean":"2024-09-12T21:53:59.011185+0000","last_became_active":"2024-09-12T21:50:39.853199+0000","last_became_peered":"2024-09-12T21:50:39.853199+0000","last_unstale":"2024-09-12T21:53:59.011185+0000","last_undegraded":"2024-09-12T21:53:59.011185+0000","last_fullsized":"2024-09-12T21:53:59.011185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:59.108053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629082+0000","last_change":"2024-09-12T21:51:22.308686+0000","last_active":"2024-09-12T21:52:55.629082+0000","last_peered":"2024-09-12T21:52:55.629082+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308686+0000","last_became_peered":"2024-09-12T21:51:22.308686+0000","last_unstale":"2024-09-12T21:52:55.629082+0000","last_undegraded":"2024-09-12T21:52:55.629082+0000","last_fullsized":"2024-09-12T21:51:22.305597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:11.406814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010126+0000","last_change":"2024-09-12T21:50:39.852470+0000","last_active":"2024-09-12T21:53:59.010126+0000","last_peered":"2024-09-12T21:53:59.010126+0000","last_clean":"2024-09-12T21:53:59.010126+0000","last_became_active":"2024-09-12T21:50:39.851633+0000","last_became_peered":"2024-09-12T21:50:39.851633+0000","last_unstale":"2024-09-12T21:53:59.010126+0000","last_undegraded":"2024-09-12T21:53:59.010126+0000","last_fullsized":"2024-09-12T21:53:59.010126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010100+0000","last_change":"2024-09-12T21:50:39.848899+0000","last_active":"2024-09-12T21:53:59.010100+0000","last_peered":"2024-09-12T21:53:59.010100+0000","last_clean":"2024-09-12T21:53:59.010100+0000","last_became_active":"2024-09-12T21:50:39.848495+0000","last_became_peered":"2024-09-12T21:50:39.848495+0000","last_unstale":"2024-09-12T21:53:59.010100+0000","last_undegraded":"2024-09-12T21:53:59.010100+0000","last_fullsized":"2024-09-12T21:53:59.010100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009911+0000","last_change":"2024-09-12T21:50:39.853036+0000","last_active":"2024-09-12T21:53:59.009911+0000","last_peered":"2024-09-12T21:53:59.009911+0000","last_clean":"2024-09-12T21:53:59.009911+0000","last_became_active":"2024-09-12T21:50:39.852482+0000","last_became_peered":"2024-09-12T21:50:39.852482+0000","last_unstale":"2024-09-12T21:53:59.009911+0000","last_undegraded":"2024-09-12T21:53:59.009911+0000","last_fullsized":"2024-09-12T21:53:59.009911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:07.051214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010908+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:53:59.010908+0000","last_peered":"2024-09-12T21:53:59.010908+0000","last_clean":"2024-09-12T21:53:59.010908+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:53:59.010908+0000","last_undegraded":"2024-09-12T21:53:59.010908+0000","last_fullsized":"2024-09-12T21:53:59.010908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629693+0000","last_change":"2024-09-12T21:51:22.325625+0000","last_active":"2024-09-12T21:52:55.629693+0000","last_peered":"2024-09-12T21:52:55.629693+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.325625+0000","last_became_peered":"2024-09-12T21:51:22.325625+0000","last_unstale":"2024-09-12T21:52:55.629693+0000","last_undegraded":"2024-09-12T21:52:55.629693+0000","last_fullsized":"2024-09-12T21:51:22.306385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:57.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011224+0000","last_change":"2024-09-12T21:50:39.851580+0000","last_active":"2024-09-12T21:53:59.011224+0000","last_peered":"2024-09-12T21:53:59.011224+0000","last_clean":"2024-09-12T21:53:59.011224+0000","last_became_active":"2024-09-12T21:50:39.850810+0000","last_became_peered":"2024-09-12T21:50:39.850810+0000","last_unstale":"2024-09-12T21:53:59.011224+0000","last_undegraded":"2024-09-12T21:53:59.011224+0000","last_fullsized":"2024-09-12T21:53:59.011224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:17.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629464+0000","last_change":"2024-09-12T21:51:22.308305+0000","last_active":"2024-09-12T21:52:55.629464+0000","last_peered":"2024-09-12T21:52:55.629464+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308305+0000","last_became_peered":"2024-09-12T21:51:22.308305+0000","last_unstale":"2024-09-12T21:52:55.629464+0000","last_undegraded":"2024-09-12T21:52:55.629464+0000","last_fullsized":"2024-09-12T21:51:22.305646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:40.213204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629988+0000","last_change":"2024-09-12T21:51:22.309352+0000","last_active":"2024-09-12T21:52:55.629988+0000","last_peered":"2024-09-12T21:52:55.629988+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309352+0000","last_became_peered":"2024-09-12T21:51:22.309352+0000","last_unstale":"2024-09-12T21:52:55.629988+0000","last_undegraded":"2024-09-12T21:52:55.629988+0000","last_fullsized":"2024-09-12T21:51:22.306258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:22.607885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010387+0000","last_change":"2024-09-12T21:53:58.041552+0000","last_active":"2024-09-12T21:53:59.010387+0000","last_peered":"2024-09-12T21:53:59.010387+0000","last_clean":"2024-09-12T21:53:59.010387+0000","last_became_active":"2024-09-12T21:53:58.040203+0000","last_became_peered":"2024-09-12T21:53:58.040203+0000","last_unstale":"2024-09-12T21:53:59.010387+0000","last_undegraded":"2024-09-12T21:53:59.010387+0000","last_fullsized":"2024-09-12T21:53:59.010387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:58.900117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010155+0000","last_change":"2024-09-12T21:53:58.041791+0000","last_active":"2024-09-12T21:53:59.010155+0000","last_peered":"2024-09-12T21:53:59.010155+0000","last_clean":"2024-09-12T21:53:59.010155+0000","last_became_active":"2024-09-12T21:53:58.041201+0000","last_became_peered":"2024-09-12T21:53:58.041201+0000","last_unstale":"2024-09-12T21:53:59.010155+0000","last_undegraded":"2024-09-12T21:53:59.010155+0000","last_fullsized":"2024-09-12T21:53:59.010155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009938+0000","last_change":"2024-09-12T21:50:39.851410+0000","last_active":"2024-09-12T21:53:59.009938+0000","last_peered":"2024-09-12T21:53:59.009938+0000","last_clean":"2024-09-12T21:53:59.009938+0000","last_became_active":"2024-09-12T21:50:39.850792+0000","last_became_peered":"2024-09-12T21:50:39.850792+0000","last_unstale":"2024-09-12T21:53:59.009938+0000","last_undegraded":"2024-09-12T21:53:59.009938+0000","last_fullsized":"2024-09-12T21:53:59.009938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:53.431515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011156+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:53:59.011156+0000","last_peered":"2024-09-12T21:53:59.011156+0000","last_clean":"2024-09-12T21:53:59.011156+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:53:59.011156+0000","last_undegraded":"2024-09-12T21:53:59.011156+0000","last_fullsized":"2024-09-12T21:53:59.011156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630438+0000","last_change":"2024-09-12T21:51:22.328021+0000","last_active":"2024-09-12T21:52:55.630438+0000","last_peered":"2024-09-12T21:52:55.630438+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.328021+0000","last_became_peered":"2024-09-12T21:51:22.328021+0000","last_unstale":"2024-09-12T21:52:55.630438+0000","last_undegraded":"2024-09-12T21:52:55.630438+0000","last_fullsized":"2024-09-12T21:51:22.307876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:33.926870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010446+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:53:59.010446+0000","last_peered":"2024-09-12T21:53:59.010446+0000","last_clean":"2024-09-12T21:53:59.010446+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:53:59.010446+0000","last_undegraded":"2024-09-12T21:53:59.010446+0000","last_fullsized":"2024-09-12T21:53:59.010446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010481+0000","last_change":"2024-09-12T21:50:39.854972+0000","last_active":"2024-09-12T21:53:59.010481+0000","last_peered":"2024-09-12T21:53:59.010481+0000","last_clean":"2024-09-12T21:53:59.010481+0000","last_became_active":"2024-09-12T21:50:39.852893+0000","last_became_peered":"2024-09-12T21:50:39.852893+0000","last_unstale":"2024-09-12T21:53:59.010481+0000","last_undegraded":"2024-09-12T21:53:59.010481+0000","last_fullsized":"2024-09-12T21:53:59.010481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010459+0000","last_change":"2024-09-12T21:50:39.852601+0000","last_active":"2024-09-12T21:53:59.010459+0000","last_peered":"2024-09-12T21:53:59.010459+0000","last_clean":"2024-09-12T21:53:59.010459+0000","last_became_active":"2024-09-12T21:50:39.852032+0000","last_became_peered":"2024-09-12T21:50:39.852032+0000","last_unstale":"2024-09-12T21:53:59.010459+0000","last_undegraded":"2024-09-12T21:53:59.010459+0000","last_fullsized":"2024-09-12T21:53:59.010459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.452181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630336+0000","last_change":"2024-09-12T21:51:22.309302+0000","last_active":"2024-09-12T21:52:55.630336+0000","last_peered":"2024-09-12T21:52:55.630336+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309302+0000","last_became_peered":"2024-09-12T21:51:22.309302+0000","last_unstale":"2024-09-12T21:52:55.630336+0000","last_undegraded":"2024-09-12T21:52:55.630336+0000","last_fullsized":"2024-09-12T21:51:22.305877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:12.391366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009612+0000","last_change":"2024-09-12T21:50:39.850812+0000","last_active":"2024-09-12T21:53:59.009612+0000","last_peered":"2024-09-12T21:53:59.009612+0000","last_clean":"2024-09-12T21:53:59.009612+0000","last_became_active":"2024-09-12T21:50:39.850273+0000","last_became_peered":"2024-09-12T21:50:39.850273+0000","last_unstale":"2024-09-12T21:53:59.009612+0000","last_undegraded":"2024-09-12T21:53:59.009612+0000","last_fullsized":"2024-09-12T21:53:59.009612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628688+0000","last_change":"2024-09-12T21:51:22.317902+0000","last_active":"2024-09-12T21:52:55.628688+0000","last_peered":"2024-09-12T21:52:55.628688+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.317902+0000","last_became_peered":"2024-09-12T21:51:22.317902+0000","last_unstale":"2024-09-12T21:52:55.628688+0000","last_undegraded":"2024-09-12T21:52:55.628688+0000","last_fullsized":"2024-09-12T21:51:22.305232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:31.525706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630620+0000","last_change":"2024-09-12T21:51:22.318217+0000","last_active":"2024-09-12T21:52:55.630620+0000","last_peered":"2024-09-12T21:52:55.630620+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.318217+0000","last_became_peered":"2024-09-12T21:51:22.318217+0000","last_unstale":"2024-09-12T21:52:55.630620+0000","last_undegraded":"2024-09-12T21:52:55.630620+0000","last_fullsized":"2024-09-12T21:51:22.308047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.469001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010809+0000","last_change":"2024-09-12T21:50:39.854736+0000","last_active":"2024-09-12T21:53:59.010809+0000","last_peered":"2024-09-12T21:53:59.010809+0000","last_clean":"2024-09-12T21:53:59.010809+0000","last_became_active":"2024-09-12T21:50:39.854348+0000","last_became_peered":"2024-09-12T21:50:39.854348+0000","last_unstale":"2024-09-12T21:53:59.010809+0000","last_undegraded":"2024-09-12T21:53:59.010809+0000","last_fullsized":"2024-09-12T21:53:59.010809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.941091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011237+0000","last_change":"2024-09-12T21:53:58.040332+0000","last_active":"2024-09-12T21:53:59.011237+0000","last_peered":"2024-09-12T21:53:59.011237+0000","last_clean":"2024-09-12T21:53:59.011237+0000","last_became_active":"2024-09-12T21:53:58.038996+0000","last_became_peered":"2024-09-12T21:53:58.038996+0000","last_unstale":"2024-09-12T21:53:59.011237+0000","last_undegraded":"2024-09-12T21:53:59.011237+0000","last_fullsized":"2024-09-12T21:53:59.011237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629478+0000","last_change":"2024-09-12T21:51:22.309042+0000","last_active":"2024-09-12T21:52:55.629478+0000","last_peered":"2024-09-12T21:52:55.629478+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309042+0000","last_became_peered":"2024-09-12T21:51:22.309042+0000","last_unstale":"2024-09-12T21:52:55.629478+0000","last_undegraded":"2024-09-12T21:52:55.629478+0000","last_fullsized":"2024-09-12T21:51:22.305608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.304115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010438+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:53:59.010438+0000","last_peered":"2024-09-12T21:53:59.010438+0000","last_clean":"2024-09-12T21:53:59.010438+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:53:59.010438+0000","last_undegraded":"2024-09-12T21:53:59.010438+0000","last_fullsized":"2024-09-12T21:53:59.010438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629168+0000","last_change":"2024-09-12T21:51:22.309094+0000","last_active":"2024-09-12T21:52:55.629168+0000","last_peered":"2024-09-12T21:52:55.629168+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309094+0000","last_became_peered":"2024-09-12T21:51:22.309094+0000","last_unstale":"2024-09-12T21:52:55.629168+0000","last_undegraded":"2024-09-12T21:52:55.629168+0000","last_fullsized":"2024-09-12T21:51:22.305342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:11.233523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009667+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:53:59.009667+0000","last_peered":"2024-09-12T21:53:59.009667+0000","last_clean":"2024-09-12T21:53:59.009667+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:53:59.009667+0000","last_undegraded":"2024-09-12T21:53:59.009667+0000","last_fullsized":"2024-09-12T21:53:59.009667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010063+0000","last_change":"2024-09-12T21:50:39.849733+0000","last_active":"2024-09-12T21:53:59.010063+0000","last_peered":"2024-09-12T21:53:59.010063+0000","last_clean":"2024-09-12T21:53:59.010063+0000","last_became_active":"2024-09-12T21:50:39.848579+0000","last_became_peered":"2024-09-12T21:50:39.848579+0000","last_unstale":"2024-09-12T21:53:59.010063+0000","last_undegraded":"2024-09-12T21:53:59.010063+0000","last_fullsized":"2024-09-12T21:53:59.010063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:09.449872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629569+0000","last_change":"2024-09-12T21:51:22.309367+0000","last_active":"2024-09-12T21:52:55.629569+0000","last_peered":"2024-09-12T21:52:55.629569+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309367+0000","last_became_peered":"2024-09-12T21:51:22.309367+0000","last_unstale":"2024-09-12T21:52:55.629569+0000","last_undegraded":"2024-09-12T21:52:55.629569+0000","last_fullsized":"2024-09-12T21:51:22.305699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:20.692923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010837+0000","last_change":"2024-09-12T21:50:38.850690+0000","last_active":"2024-09-12T21:53:59.010837+0000","last_peered":"2024-09-12T21:53:59.010837+0000","last_clean":"2024-09-12T21:53:59.010837+0000","last_became_active":"2024-09-12T21:50:38.850045+0000","last_became_peered":"2024-09-12T21:50:38.850045+0000","last_unstale":"2024-09-12T21:53:59.010837+0000","last_undegraded":"2024-09-12T21:53:59.010837+0000","last_fullsized":"2024-09-12T21:53:59.010837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:01.638295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629806+0000","last_change":"2024-09-12T21:51:22.309051+0000","last_active":"2024-09-12T21:52:55.629806+0000","last_peered":"2024-09-12T21:52:55.629806+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309051+0000","last_became_peered":"2024-09-12T21:51:22.309051+0000","last_unstale":"2024-09-12T21:52:55.629806+0000","last_undegraded":"2024-09-12T21:52:55.629806+0000","last_fullsized":"2024-09-12T21:51:22.306134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:16.283740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.630564+0000","last_change":"2024-09-12T21:51:24.427714+0000","last_active":"2024-09-12T21:52:55.630564+0000","last_peered":"2024-09-12T21:52:55.630564+0000","last_clean":"2024-09-12T21:52:55.630564+0000","last_became_active":"2024-09-12T21:51:24.427318+0000","last_became_peered":"2024-09-12T21:51:24.427318+0000","last_unstale":"2024-09-12T21:52:55.630564+0000","last_undegraded":"2024-09-12T21:52:55.630564+0000","last_fullsized":"2024-09-12T21:52:55.630564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:09.128038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011024+0000","last_change":"2024-09-12T21:50:39.856658+0000","last_active":"2024-09-12T21:53:59.011024+0000","last_peered":"2024-09-12T21:53:59.011024+0000","last_clean":"2024-09-12T21:53:59.011024+0000","last_became_active":"2024-09-12T21:50:39.856256+0000","last_became_peered":"2024-09-12T21:50:39.856256+0000","last_unstale":"2024-09-12T21:53:59.011024+0000","last_undegraded":"2024-09-12T21:53:59.011024+0000","last_fullsized":"2024-09-12T21:53:59.011024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:42.361534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629363+0000","last_change":"2024-09-12T21:51:22.311373+0000","last_active":"2024-09-12T21:52:55.629363+0000","last_peered":"2024-09-12T21:52:55.629363+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.311373+0000","last_became_peered":"2024-09-12T21:51:22.311373+0000","last_unstale":"2024-09-12T21:52:55.629363+0000","last_undegraded":"2024-09-12T21:52:55.629363+0000","last_fullsized":"2024-09-12T21:51:22.306140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:30.521850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010608+0000","last_change":"2024-09-12T21:50:39.854805+0000","last_active":"2024-09-12T21:53:59.010608+0000","last_peered":"2024-09-12T21:53:59.010608+0000","last_clean":"2024-09-12T21:53:59.010608+0000","last_became_active":"2024-09-12T21:50:39.854464+0000","last_became_peered":"2024-09-12T21:50:39.854464+0000","last_unstale":"2024-09-12T21:53:59.010608+0000","last_undegraded":"2024-09-12T21:53:59.010608+0000","last_fullsized":"2024-09-12T21:53:59.010608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:29.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010073+0000","last_change":"2024-09-12T21:53:58.042708+0000","last_active":"2024-09-12T21:53:59.010073+0000","last_peered":"2024-09-12T21:53:59.010073+0000","last_clean":"2024-09-12T21:53:59.010073+0000","last_became_active":"2024-09-12T21:53:58.041891+0000","last_became_peered":"2024-09-12T21:53:58.041891+0000","last_unstale":"2024-09-12T21:53:59.010073+0000","last_undegraded":"2024-09-12T21:53:59.010073+0000","last_fullsized":"2024-09-12T21:53:59.010073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011089+0000","last_change":"2024-09-12T21:53:58.042420+0000","last_active":"2024-09-12T21:53:59.011089+0000","last_peered":"2024-09-12T21:53:59.011089+0000","last_clean":"2024-09-12T21:53:59.011089+0000","last_became_active":"2024-09-12T21:53:58.040977+0000","last_became_peered":"2024-09-12T21:53:58.040977+0000","last_unstale":"2024-09-12T21:53:59.011089+0000","last_undegraded":"2024-09-12T21:53:59.011089+0000","last_fullsized":"2024-09-12T21:53:59.011089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628895+0000","last_change":"2024-09-12T21:51:22.307218+0000","last_active":"2024-09-12T21:52:55.628895+0000","last_peered":"2024-09-12T21:52:55.628895+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.307218+0000","last_became_peered":"2024-09-12T21:51:22.307218+0000","last_unstale":"2024-09-12T21:52:55.628895+0000","last_undegraded":"2024-09-12T21:52:55.628895+0000","last_fullsized":"2024-09-12T21:51:22.305215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:51.049086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.630115+0000","last_change":"2024-09-12T21:51:22.309034+0000","last_active":"2024-09-12T21:52:55.630115+0000","last_peered":"2024-09-12T21:52:55.630115+0000","last_clean":"2024-09-12T21:50:39.844868+0000","last_became_active":"2024-09-12T21:51:22.309034+0000","last_became_peered":"2024-09-12T21:51:22.309034+0000","last_unstale":"2024-09-12T21:52:55.630115+0000","last_undegraded":"2024-09-12T21:51:22.307075+0000","last_fullsized":"2024-09-12T21:51:22.306997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629018+0000","last_change":"2024-09-12T21:51:22.308150+0000","last_active":"2024-09-12T21:52:55.629018+0000","last_peered":"2024-09-12T21:52:55.629018+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308150+0000","last_became_peered":"2024-09-12T21:51:22.308150+0000","last_unstale":"2024-09-12T21:52:55.629018+0000","last_undegraded":"2024-09-12T21:52:55.629018+0000","last_fullsized":"2024-09-12T21:51:22.305398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:14.373363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011490+0000","last_change":"2024-09-12T21:53:58.041477+0000","last_active":"2024-09-12T21:53:59.011490+0000","last_peered":"2024-09-12T21:53:59.011490+0000","last_clean":"2024-09-12T21:53:59.011490+0000","last_became_active":"2024-09-12T21:53:58.040138+0000","last_became_peered":"2024-09-12T21:53:58.040138+0000","last_unstale":"2024-09-12T21:53:59.011490+0000","last_undegraded":"2024-09-12T21:53:59.011490+0000","last_fullsized":"2024-09-12T21:53:59.011490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:22.389857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010664+0000","last_change":"2024-09-12T21:50:39.849606+0000","last_active":"2024-09-12T21:53:59.010664+0000","last_peered":"2024-09-12T21:53:59.010664+0000","last_clean":"2024-09-12T21:53:59.010664+0000","last_became_active":"2024-09-12T21:50:39.848559+0000","last_became_peered":"2024-09-12T21:50:39.848559+0000","last_unstale":"2024-09-12T21:53:59.010664+0000","last_undegraded":"2024-09-12T21:53:59.010664+0000","last_fullsized":"2024-09-12T21:53:59.010664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:55.055013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.630196+0000","last_change":"2024-09-12T21:51:24.415653+0000","last_active":"2024-09-12T21:52:55.630196+0000","last_peered":"2024-09-12T21:52:55.630196+0000","last_clean":"2024-09-12T21:52:55.630196+0000","last_became_active":"2024-09-12T21:51:24.415275+0000","last_became_peered":"2024-09-12T21:51:24.415275+0000","last_unstale":"2024-09-12T21:52:55.630196+0000","last_undegraded":"2024-09-12T21:52:55.630196+0000","last_fullsized":"2024-09-12T21:52:55.630196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:47.465146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010720+0000","last_change":"2024-09-12T21:50:39.855062+0000","last_active":"2024-09-12T21:53:59.010720+0000","last_peered":"2024-09-12T21:53:59.010720+0000","last_clean":"2024-09-12T21:53:59.010720+0000","last_became_active":"2024-09-12T21:50:39.854513+0000","last_became_peered":"2024-09-12T21:50:39.854513+0000","last_unstale":"2024-09-12T21:53:59.010720+0000","last_undegraded":"2024-09-12T21:53:59.010720+0000","last_fullsized":"2024-09-12T21:53:59.010720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:34.161801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010750+0000","last_change":"2024-09-12T21:50:38.850389+0000","last_active":"2024-09-12T21:53:59.010750+0000","last_peered":"2024-09-12T21:53:59.010750+0000","last_clean":"2024-09-12T21:53:59.010750+0000","last_became_active":"2024-09-12T21:50:38.849614+0000","last_became_peered":"2024-09-12T21:50:38.849614+0000","last_unstale":"2024-09-12T21:53:59.010750+0000","last_undegraded":"2024-09-12T21:53:59.010750+0000","last_fullsized":"2024-09-12T21:53:59.010750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010587+0000","last_change":"2024-09-12T21:50:39.853962+0000","last_active":"2024-09-12T21:53:59.010587+0000","last_peered":"2024-09-12T21:53:59.010587+0000","last_clean":"2024-09-12T21:53:59.010587+0000","last_became_active":"2024-09-12T21:50:39.852017+0000","last_became_peered":"2024-09-12T21:50:39.852017+0000","last_unstale":"2024-09-12T21:53:59.010587+0000","last_undegraded":"2024-09-12T21:53:59.010587+0000","last_fullsized":"2024-09-12T21:53:59.010587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:56.436497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010738+0000","last_change":"2024-09-12T21:50:38.850859+0000","last_active":"2024-09-12T21:53:59.010738+0000","last_peered":"2024-09-12T21:53:59.010738+0000","last_clean":"2024-09-12T21:53:59.010738+0000","last_became_active":"2024-09-12T21:50:38.850234+0000","last_became_peered":"2024-09-12T21:50:38.850234+0000","last_unstale":"2024-09-12T21:53:59.010738+0000","last_undegraded":"2024-09-12T21:53:59.010738+0000","last_fullsized":"2024-09-12T21:53:59.010738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:31.811602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011370+0000","last_change":"2024-09-12T21:53:58.040759+0000","last_active":"2024-09-12T21:53:59.011370+0000","last_peered":"2024-09-12T21:53:59.011370+0000","last_clean":"2024-09-12T21:53:59.011370+0000","last_became_active":"2024-09-12T21:53:58.039636+0000","last_became_peered":"2024-09-12T21:53:58.039636+0000","last_unstale":"2024-09-12T21:53:59.011370+0000","last_undegraded":"2024-09-12T21:53:59.011370+0000","last_fullsized":"2024-09-12T21:53:59.011370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629058+0000","last_change":"2024-09-12T21:51:22.310964+0000","last_active":"2024-09-12T21:52:55.629058+0000","last_peered":"2024-09-12T21:52:55.629058+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.310964+0000","last_became_peered":"2024-09-12T21:51:22.310964+0000","last_unstale":"2024-09-12T21:52:55.629058+0000","last_undegraded":"2024-09-12T21:52:55.629058+0000","last_fullsized":"2024-09-12T21:51:22.305639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:22.284406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010920+0000","last_change":"2024-09-12T21:53:58.041801+0000","last_active":"2024-09-12T21:53:59.010920+0000","last_peered":"2024-09-12T21:53:59.010920+0000","last_clean":"2024-09-12T21:53:59.010920+0000","last_became_active":"2024-09-12T21:53:58.041203+0000","last_became_peered":"2024-09-12T21:53:58.041203+0000","last_unstale":"2024-09-12T21:53:59.010920+0000","last_undegraded":"2024-09-12T21:53:59.010920+0000","last_fullsized":"2024-09-12T21:53:59.010920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628977+0000","last_change":"2024-09-12T21:51:22.320670+0000","last_active":"2024-09-12T21:52:55.628977+0000","last_peered":"2024-09-12T21:52:55.628977+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.320670+0000","last_became_peered":"2024-09-12T21:51:22.320670+0000","last_unstale":"2024-09-12T21:52:55.628977+0000","last_undegraded":"2024-09-12T21:52:55.628977+0000","last_fullsized":"2024-09-12T21:51:22.305552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:24.241327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010796+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:53:59.010796+0000","last_peered":"2024-09-12T21:53:59.010796+0000","last_clean":"2024-09-12T21:53:59.010796+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:53:59.010796+0000","last_undegraded":"2024-09-12T21:53:59.010796+0000","last_fullsized":"2024-09-12T21:53:59.010796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":342,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010325+0000","last_change":"2024-09-12T21:53:58.043230+0000","last_active":"2024-09-12T21:53:59.010325+0000","last_peered":"2024-09-12T21:53:59.010325+0000","last_clean":"2024-09-12T21:53:59.010325+0000","last_became_active":"2024-09-12T21:53:58.042758+0000","last_became_peered":"2024-09-12T21:53:58.042758+0000","last_unstale":"2024-09-12T21:53:59.010325+0000","last_undegraded":"2024-09-12T21:53:59.010325+0000","last_fullsized":"2024-09-12T21:53:59.010325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:24.578612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":151,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.018078+0000","last_change":"2024-09-12T21:53:59.018078+0000","last_active":"2024-09-12T21:53:59.018078+0000","last_peered":"2024-09-12T21:53:59.018078+0000","last_clean":"2024-09-12T21:53:59.018078+0000","last_became_active":"2024-09-12T21:53:59.014336+0000","last_became_peered":"2024-09-12T21:53:59.014336+0000","last_unstale":"2024-09-12T21:53:59.018078+0000","last_undegraded":"2024-09-12T21:53:59.018078+0000","last_fullsized":"2024-09-12T21:53:59.018078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:27.734206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010111+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:53:59.010111+0000","last_peered":"2024-09-12T21:53:59.010111+0000","last_clean":"2024-09-12T21:53:59.010111+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:53:59.010111+0000","last_undegraded":"2024-09-12T21:53:59.010111+0000","last_fullsized":"2024-09-12T21:53:59.010111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011417+0000","last_change":"2024-09-12T21:53:58.040621+0000","last_active":"2024-09-12T21:53:59.011417+0000","last_peered":"2024-09-12T21:53:59.011417+0000","last_clean":"2024-09-12T21:53:59.011417+0000","last_became_active":"2024-09-12T21:53:58.039604+0000","last_became_peered":"2024-09-12T21:53:58.039604+0000","last_unstale":"2024-09-12T21:53:59.011417+0000","last_undegraded":"2024-09-12T21:53:59.011417+0000","last_fullsized":"2024-09-12T21:53:59.011417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010224+0000","last_change":"2024-09-12T21:53:58.042035+0000","last_active":"2024-09-12T21:53:59.010224+0000","last_peered":"2024-09-12T21:53:59.010224+0000","last_clean":"2024-09-12T21:53:59.010224+0000","last_became_active":"2024-09-12T21:53:58.040375+0000","last_became_peered":"2024-09-12T21:53:58.040375+0000","last_unstale":"2024-09-12T21:53:59.010224+0000","last_undegraded":"2024-09-12T21:53:59.010224+0000","last_fullsized":"2024-09-12T21:53:59.010224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:41.072643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.014497+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:53:59.014497+0000","last_peered":"2024-09-12T21:53:59.014497+0000","last_clean":"2024-09-12T21:53:59.014497+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:53:59.014497+0000","last_undegraded":"2024-09-12T21:53:59.014497+0000","last_fullsized":"2024-09-12T21:53:59.014497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629780+0000","last_change":"2024-09-12T21:51:22.327773+0000","last_active":"2024-09-12T21:52:55.629780+0000","last_peered":"2024-09-12T21:52:55.629780+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.327773+0000","last_became_peered":"2024-09-12T21:51:22.327773+0000","last_unstale":"2024-09-12T21:52:55.629780+0000","last_undegraded":"2024-09-12T21:52:55.629780+0000","last_fullsized":"2024-09-12T21:51:22.306512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:02.325480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010311+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:53:59.010311+0000","last_peered":"2024-09-12T21:53:59.010311+0000","last_clean":"2024-09-12T21:53:59.010311+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:53:59.010311+0000","last_undegraded":"2024-09-12T21:53:59.010311+0000","last_fullsized":"2024-09-12T21:53:59.010311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628964+0000","last_change":"2024-09-12T21:51:22.308260+0000","last_active":"2024-09-12T21:52:55.628964+0000","last_peered":"2024-09-12T21:52:55.628964+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.308260+0000","last_became_peered":"2024-09-12T21:51:22.308260+0000","last_unstale":"2024-09-12T21:52:55.628964+0000","last_undegraded":"2024-09-12T21:52:55.628964+0000","last_fullsized":"2024-09-12T21:51:22.305290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:22.300810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010992+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:53:59.010992+0000","last_peered":"2024-09-12T21:53:59.010992+0000","last_clean":"2024-09-12T21:53:59.010992+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:53:59.010992+0000","last_undegraded":"2024-09-12T21:53:59.010992+0000","last_fullsized":"2024-09-12T21:53:59.010992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010889+0000","last_change":"2024-09-12T21:50:36.721882+0000","last_active":"2024-09-12T21:53:59.010889+0000","last_peered":"2024-09-12T21:53:59.010889+0000","last_clean":"2024-09-12T21:53:59.010889+0000","last_became_active":"2024-09-12T21:50:34.717992+0000","last_became_peered":"2024-09-12T21:50:34.717992+0000","last_unstale":"2024-09-12T21:53:59.010889+0000","last_undegraded":"2024-09-12T21:53:59.010889+0000","last_fullsized":"2024-09-12T21:53:59.010889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:04.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010938+0000","last_change":"2024-09-12T21:50:38.851660+0000","last_active":"2024-09-12T21:53:59.010938+0000","last_peered":"2024-09-12T21:53:59.010938+0000","last_clean":"2024-09-12T21:53:59.010938+0000","last_became_active":"2024-09-12T21:50:38.850183+0000","last_became_peered":"2024-09-12T21:50:38.850183+0000","last_unstale":"2024-09-12T21:53:59.010938+0000","last_undegraded":"2024-09-12T21:53:59.010938+0000","last_fullsized":"2024-09-12T21:53:59.010938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:11.738189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010642+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:53:59.010642+0000","last_peered":"2024-09-12T21:53:59.010642+0000","last_clean":"2024-09-12T21:53:59.010642+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:53:59.010642+0000","last_undegraded":"2024-09-12T21:53:59.010642+0000","last_fullsized":"2024-09-12T21:53:59.010642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011507+0000","last_change":"2024-09-12T21:50:38.850561+0000","last_active":"2024-09-12T21:53:59.011507+0000","last_peered":"2024-09-12T21:53:59.011507+0000","last_clean":"2024-09-12T21:53:59.011507+0000","last_became_active":"2024-09-12T21:50:38.850090+0000","last_became_peered":"2024-09-12T21:50:38.850090+0000","last_unstale":"2024-09-12T21:53:59.011507+0000","last_undegraded":"2024-09-12T21:53:59.011507+0000","last_fullsized":"2024-09-12T21:53:59.011507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:17.385950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010822+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:53:59.010822+0000","last_peered":"2024-09-12T21:53:59.010822+0000","last_clean":"2024-09-12T21:53:59.010822+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:53:59.010822+0000","last_undegraded":"2024-09-12T21:53:59.010822+0000","last_fullsized":"2024-09-12T21:53:59.010822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629199+0000","last_change":"2024-09-12T21:51:22.308555+0000","last_active":"2024-09-12T21:52:55.629199+0000","last_peered":"2024-09-12T21:52:55.629199+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308555+0000","last_became_peered":"2024-09-12T21:51:22.308555+0000","last_unstale":"2024-09-12T21:52:55.629199+0000","last_undegraded":"2024-09-12T21:52:55.629199+0000","last_fullsized":"2024-09-12T21:51:22.305522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:34.264392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010754+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:53:59.010754+0000","last_peered":"2024-09-12T21:53:59.010754+0000","last_clean":"2024-09-12T21:53:59.010754+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:53:59.010754+0000","last_undegraded":"2024-09-12T21:53:59.010754+0000","last_fullsized":"2024-09-12T21:53:59.010754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630198+0000","last_change":"2024-09-12T21:51:22.309235+0000","last_active":"2024-09-12T21:52:55.630198+0000","last_peered":"2024-09-12T21:52:55.630198+0000","last_clean":"2024-09-12T21:50:33.704973+0000","last_became_active":"2024-09-12T21:51:22.309235+0000","last_became_peered":"2024-09-12T21:51:22.309235+0000","last_unstale":"2024-09-12T21:52:55.630198+0000","last_undegraded":"2024-09-12T21:52:55.630198+0000","last_fullsized":"2024-09-12T21:51:22.306888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:09.811005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629499+0000","last_change":"2024-09-12T21:51:22.308344+0000","last_active":"2024-09-12T21:52:55.629499+0000","last_peered":"2024-09-12T21:52:55.629499+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.308344+0000","last_became_peered":"2024-09-12T21:51:22.308344+0000","last_unstale":"2024-09-12T21:52:55.629499+0000","last_undegraded":"2024-09-12T21:52:55.629499+0000","last_fullsized":"2024-09-12T21:51:22.305545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:20.692923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":134,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011227+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:53:59.011227+0000","last_peered":"2024-09-12T21:53:59.011227+0000","last_clean":"2024-09-12T21:53:59.011227+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:53:59.011227+0000","last_undegraded":"2024-09-12T21:53:59.011227+0000","last_fullsized":"2024-09-12T21:53:59.011227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011152+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:53:59.011152+0000","last_peered":"2024-09-12T21:53:59.011152+0000","last_clean":"2024-09-12T21:53:59.011152+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:53:59.011152+0000","last_undegraded":"2024-09-12T21:53:59.011152+0000","last_fullsized":"2024-09-12T21:53:59.011152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009827+0000","last_change":"2024-09-12T21:50:39.857381+0000","last_active":"2024-09-12T21:53:59.009827+0000","last_peered":"2024-09-12T21:53:59.009827+0000","last_clean":"2024-09-12T21:53:59.009827+0000","last_became_active":"2024-09-12T21:50:39.857099+0000","last_became_peered":"2024-09-12T21:50:39.857099+0000","last_unstale":"2024-09-12T21:53:59.009827+0000","last_undegraded":"2024-09-12T21:53:59.009827+0000","last_fullsized":"2024-09-12T21:53:59.009827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:33.140327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.016410+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:53:59.016410+0000","last_peered":"2024-09-12T21:53:59.016410+0000","last_clean":"2024-09-12T21:53:59.016410+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:53:59.016410+0000","last_undegraded":"2024-09-12T21:53:59.016410+0000","last_fullsized":"2024-09-12T21:53:59.016410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011113+0000","last_change":"2024-09-12T21:53:58.041233+0000","last_active":"2024-09-12T21:53:59.011113+0000","last_peered":"2024-09-12T21:53:59.011113+0000","last_clean":"2024-09-12T21:53:59.011113+0000","last_became_active":"2024-09-12T21:53:58.040031+0000","last_became_peered":"2024-09-12T21:53:58.040031+0000","last_unstale":"2024-09-12T21:53:59.011113+0000","last_undegraded":"2024-09-12T21:53:59.011113+0000","last_fullsized":"2024-09-12T21:53:59.011113+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629096+0000","last_change":"2024-09-12T21:51:22.311192+0000","last_active":"2024-09-12T21:52:55.629096+0000","last_peered":"2024-09-12T21:52:55.629096+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.311192+0000","last_became_peered":"2024-09-12T21:51:22.311192+0000","last_unstale":"2024-09-12T21:52:55.629096+0000","last_undegraded":"2024-09-12T21:52:55.629096+0000","last_fullsized":"2024-09-12T21:51:22.305993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:12.528560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010919+0000","last_change":"2024-09-12T21:53:58.041883+0000","last_active":"2024-09-12T21:53:59.010919+0000","last_peered":"2024-09-12T21:53:59.010919+0000","last_clean":"2024-09-12T21:53:59.010919+0000","last_became_active":"2024-09-12T21:53:58.040846+0000","last_became_peered":"2024-09-12T21:53:58.040846+0000","last_unstale":"2024-09-12T21:53:59.010919+0000","last_undegraded":"2024-09-12T21:53:59.010919+0000","last_fullsized":"2024-09-12T21:53:59.010919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.102109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010922+0000","last_change":"2024-09-12T21:53:58.044236+0000","last_active":"2024-09-12T21:53:59.010922+0000","last_peered":"2024-09-12T21:53:59.010922+0000","last_clean":"2024-09-12T21:53:59.010922+0000","last_became_active":"2024-09-12T21:53:58.043963+0000","last_became_peered":"2024-09-12T21:53:58.043963+0000","last_unstale":"2024-09-12T21:53:59.010922+0000","last_undegraded":"2024-09-12T21:53:59.010922+0000","last_fullsized":"2024-09-12T21:53:59.010922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:08.668730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009800+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:53:59.009800+0000","last_peered":"2024-09-12T21:53:59.009800+0000","last_clean":"2024-09-12T21:53:59.009800+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:53:59.009800+0000","last_undegraded":"2024-09-12T21:53:59.009800+0000","last_fullsized":"2024-09-12T21:53:59.009800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.630743+0000","last_change":"2024-09-12T21:51:22.313739+0000","last_active":"2024-09-12T21:52:55.630743+0000","last_peered":"2024-09-12T21:52:55.630743+0000","last_clean":"2024-09-12T21:50:39.844215+0000","last_became_active":"2024-09-12T21:51:22.313739+0000","last_became_peered":"2024-09-12T21:51:22.313739+0000","last_unstale":"2024-09-12T21:52:55.630743+0000","last_undegraded":"2024-09-12T21:51:22.307384+0000","last_fullsized":"2024-09-12T21:51:22.307313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.948066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011216+0000","last_change":"2024-09-12T21:50:38.852969+0000","last_active":"2024-09-12T21:53:59.011216+0000","last_peered":"2024-09-12T21:53:59.011216+0000","last_clean":"2024-09-12T21:53:59.011216+0000","last_became_active":"2024-09-12T21:50:38.852141+0000","last_became_peered":"2024-09-12T21:50:38.852141+0000","last_unstale":"2024-09-12T21:53:59.011216+0000","last_undegraded":"2024-09-12T21:53:59.011216+0000","last_fullsized":"2024-09-12T21:53:59.011216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:03.513769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009744+0000","last_change":"2024-09-12T21:50:39.854905+0000","last_active":"2024-09-12T21:53:59.009744+0000","last_peered":"2024-09-12T21:53:59.009744+0000","last_clean":"2024-09-12T21:53:59.009744+0000","last_became_active":"2024-09-12T21:50:39.854414+0000","last_became_peered":"2024-09-12T21:50:39.854414+0000","last_unstale":"2024-09-12T21:53:59.009744+0000","last_undegraded":"2024-09-12T21:53:59.009744+0000","last_fullsized":"2024-09-12T21:53:59.009744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:27.745069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011152+0000","last_change":"2024-09-12T21:50:38.851197+0000","last_active":"2024-09-12T21:53:59.011152+0000","last_peered":"2024-09-12T21:53:59.011152+0000","last_clean":"2024-09-12T21:53:59.011152+0000","last_became_active":"2024-09-12T21:50:38.850582+0000","last_became_peered":"2024-09-12T21:50:38.850582+0000","last_unstale":"2024-09-12T21:53:59.011152+0000","last_undegraded":"2024-09-12T21:53:59.011152+0000","last_fullsized":"2024-09-12T21:53:59.011152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:02.336879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":130,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009795+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:53:59.009795+0000","last_peered":"2024-09-12T21:53:59.009795+0000","last_clean":"2024-09-12T21:53:59.009795+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:53:59.009795+0000","last_undegraded":"2024-09-12T21:53:59.009795+0000","last_fullsized":"2024-09-12T21:53:59.009795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.630497+0000","last_change":"2024-09-12T21:51:22.310418+0000","last_active":"2024-09-12T21:52:55.630497+0000","last_peered":"2024-09-12T21:52:55.630497+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.310418+0000","last_became_peered":"2024-09-12T21:51:22.310418+0000","last_unstale":"2024-09-12T21:52:55.630497+0000","last_undegraded":"2024-09-12T21:52:55.630497+0000","last_fullsized":"2024-09-12T21:51:22.307973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:16.096308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010063+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:53:59.010063+0000","last_peered":"2024-09-12T21:53:59.010063+0000","last_clean":"2024-09-12T21:53:59.010063+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:53:59.010063+0000","last_undegraded":"2024-09-12T21:53:59.010063+0000","last_fullsized":"2024-09-12T21:53:59.010063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010834+0000","last_change":"2024-09-12T21:50:39.855284+0000","last_active":"2024-09-12T21:53:59.010834+0000","last_peered":"2024-09-12T21:53:59.010834+0000","last_clean":"2024-09-12T21:53:59.010834+0000","last_became_active":"2024-09-12T21:50:39.854602+0000","last_became_peered":"2024-09-12T21:50:39.854602+0000","last_unstale":"2024-09-12T21:53:59.010834+0000","last_undegraded":"2024-09-12T21:53:59.010834+0000","last_fullsized":"2024-09-12T21:53:59.010834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:43.392502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":125,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.009896+0000","last_change":"2024-09-12T21:50:38.850084+0000","last_active":"2024-09-12T21:53:59.009896+0000","last_peered":"2024-09-12T21:53:59.009896+0000","last_clean":"2024-09-12T21:53:59.009896+0000","last_became_active":"2024-09-12T21:50:38.849439+0000","last_became_peered":"2024-09-12T21:50:38.849439+0000","last_unstale":"2024-09-12T21:53:59.009896+0000","last_undegraded":"2024-09-12T21:53:59.009896+0000","last_fullsized":"2024-09-12T21:53:59.009896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.755314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629566+0000","last_change":"2024-09-12T21:51:22.309903+0000","last_active":"2024-09-12T21:52:55.629566+0000","last_peered":"2024-09-12T21:52:55.629566+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309903+0000","last_became_peered":"2024-09-12T21:51:22.309903+0000","last_unstale":"2024-09-12T21:52:55.629566+0000","last_undegraded":"2024-09-12T21:52:55.629566+0000","last_fullsized":"2024-09-12T21:51:22.306320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:14.118465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.628821+0000","last_change":"2024-09-12T21:51:22.318300+0000","last_active":"2024-09-12T21:52:55.628821+0000","last_peered":"2024-09-12T21:52:55.628821+0000","last_clean":"2024-09-12T21:50:37.827303+0000","last_became_active":"2024-09-12T21:51:22.318300+0000","last_became_peered":"2024-09-12T21:51:22.318300+0000","last_unstale":"2024-09-12T21:52:55.628821+0000","last_undegraded":"2024-09-12T21:52:55.628821+0000","last_fullsized":"2024-09-12T21:51:22.305296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:22.284406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629948+0000","last_change":"2024-09-12T21:51:22.309290+0000","last_active":"2024-09-12T21:52:55.629948+0000","last_peered":"2024-09-12T21:52:55.629948+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309290+0000","last_became_peered":"2024-09-12T21:51:22.309290+0000","last_unstale":"2024-09-12T21:52:55.629948+0000","last_undegraded":"2024-09-12T21:52:55.629948+0000","last_fullsized":"2024-09-12T21:51:22.306804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:10.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":78,"reported_epoch":70,"state":"active+clean+remapped","last_fresh":"2024-09-12T21:52:55.628871+0000","last_change":"2024-09-12T21:51:24.415349+0000","last_active":"2024-09-12T21:52:55.628871+0000","last_peered":"2024-09-12T21:52:55.628871+0000","last_clean":"2024-09-12T21:52:55.628871+0000","last_became_active":"2024-09-12T21:51:24.414817+0000","last_became_peered":"2024-09-12T21:51:24.414817+0000","last_unstale":"2024-09-12T21:52:55.628871+0000","last_undegraded":"2024-09-12T21:52:55.628871+0000","last_fullsized":"2024-09-12T21:52:55.628871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:46.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010689+0000","last_change":"2024-09-12T21:50:39.849000+0000","last_active":"2024-09-12T21:53:59.010689+0000","last_peered":"2024-09-12T21:53:59.010689+0000","last_clean":"2024-09-12T21:53:59.010689+0000","last_became_active":"2024-09-12T21:50:39.848505+0000","last_became_peered":"2024-09-12T21:50:39.848505+0000","last_unstale":"2024-09-12T21:53:59.010689+0000","last_undegraded":"2024-09-12T21:53:59.010689+0000","last_fullsized":"2024-09-12T21:53:59.010689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:17.543709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":127,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010796+0000","last_change":"2024-09-12T21:50:38.851769+0000","last_active":"2024-09-12T21:53:59.010796+0000","last_peered":"2024-09-12T21:53:59.010796+0000","last_clean":"2024-09-12T21:53:59.010796+0000","last_became_active":"2024-09-12T21:50:38.850784+0000","last_became_peered":"2024-09-12T21:50:38.850784+0000","last_unstale":"2024-09-12T21:53:59.010796+0000","last_undegraded":"2024-09-12T21:53:59.010796+0000","last_fullsized":"2024-09-12T21:53:59.010796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:20.743347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010542+0000","last_change":"2024-09-12T21:50:39.848645+0000","last_active":"2024-09-12T21:53:59.010542+0000","last_peered":"2024-09-12T21:53:59.010542+0000","last_clean":"2024-09-12T21:53:59.010542+0000","last_became_active":"2024-09-12T21:50:39.848298+0000","last_became_peered":"2024-09-12T21:50:39.848298+0000","last_unstale":"2024-09-12T21:53:59.010542+0000","last_undegraded":"2024-09-12T21:53:59.010542+0000","last_fullsized":"2024-09-12T21:53:59.010542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:25.876671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":92,"reported_epoch":70,"state":"active+undersized+degraded","last_fresh":"2024-09-12T21:52:55.629605+0000","last_change":"2024-09-12T21:51:22.313497+0000","last_active":"2024-09-12T21:52:55.629605+0000","last_peered":"2024-09-12T21:52:55.629605+0000","last_clean":"2024-09-12T21:50:39.844156+0000","last_became_active":"2024-09-12T21:51:22.313497+0000","last_became_peered":"2024-09-12T21:51:22.313497+0000","last_unstale":"2024-09-12T21:52:55.629605+0000","last_undegraded":"2024-09-12T21:51:22.307140+0000","last_fullsized":"2024-09-12T21:51:22.307069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:56.816963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":82,"reported_epoch":70,"state":"active+undersized","last_fresh":"2024-09-12T21:52:55.629234+0000","last_change":"2024-09-12T21:51:22.309192+0000","last_active":"2024-09-12T21:52:55.629234+0000","last_peered":"2024-09-12T21:52:55.629234+0000","last_clean":"2024-09-12T21:50:38.831158+0000","last_became_active":"2024-09-12T21:51:22.309192+0000","last_became_peered":"2024-09-12T21:51:22.309192+0000","last_unstale":"2024-09-12T21:52:55.629234+0000","last_undegraded":"2024-09-12T21:52:55.629234+0000","last_fullsized":"2024-09-12T21:51:22.305735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:22.209598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":133,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010986+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:53:59.010986+0000","last_peered":"2024-09-12T21:53:59.010986+0000","last_clean":"2024-09-12T21:53:59.010986+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:53:59.010986+0000","last_undegraded":"2024-09-12T21:53:59.010986+0000","last_fullsized":"2024-09-12T21:53:59.010986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.010204+0000","last_change":"2024-09-12T21:50:39.850308+0000","last_active":"2024-09-12T21:53:59.010204+0000","last_peered":"2024-09-12T21:53:59.010204+0000","last_clean":"2024-09-12T21:53:59.010204+0000","last_became_active":"2024-09-12T21:50:39.849510+0000","last_became_peered":"2024-09-12T21:50:39.849510+0000","last_unstale":"2024-09-12T21:53:59.010204+0000","last_undegraded":"2024-09-12T21:53:59.010204+0000","last_fullsized":"2024-09-12T21:53:59.010204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:14.943054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":129,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T21:53:59.011032+0000","last_change":"2024-09-12T21:50:38.850523+0000","last_active":"2024-09-12T21:53:59.011032+0000","last_peered":"2024-09-12T21:53:59.011032+0000","last_clean":"2024-09-12T21:53:59.011032+0000","last_became_active":"2024-09-12T21:50:38.849459+0000","last_became_peered":"2024-09-12T21:50:38.849459+0000","last_unstale":"2024-09-12T21:53:59.011032+0000","last_undegraded":"2024-09-12T21:53:59.011032+0000","last_fullsized":"2024-09-12T21:53:59.011032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:00.667313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":53,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2436516,"kb_used_data":2401172,"kb_used_omap":5,"kb_used_meta":35322,"kb_avail":91935324,"statfs":{"total":96636764160,"available":94141771776,"internally_reserved":0,"allocated":2458800128,"data_stored":2458573591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":36169830},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437392,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934448,"statfs":{"total":96636764160,"available":96188874752,"internally_reserved":0,"allocated":839680,"data_stored":331724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383848,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":382398,"kb_avail":93987992,"statfs":{"total":96636764160,"available":96243703808,"internally_reserved":0,"allocated":1458176,"data_stored":923886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":391576005},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:54:01.698 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T21:54:01.698 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T21:54:01.698 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-09-12T21:54:01.698 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:54:01.698 INFO:teuthology.orchestra.console.smithi089:Power off 2024-09-12T21:54:01.699 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T21:54:01.722 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2024-09-12T21:54:05.723 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:54:05.834 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-09-12T21:54:07.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T21:54:09.834 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:54:09.946 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-09-12T21:54:13.837 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-12T21:54:13.946 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:54:14.057 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-09-12T21:54:14.057 INFO:teuthology.orchestra.console.smithi089:Power off completed 2024-09-12T21:54:19.159 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-12T21:54:19.159 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-12T21:54:19.159 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:54:19.160 INFO:teuthology.orchestra.console.smithi089:Power on 2024-09-12T21:54:19.160 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T21:54:19.182 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2024-09-12T21:54:19.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-09-12T21:54:23.183 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T21:54:23.295 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-09-12T21:54:23.296 INFO:teuthology.orchestra.console.smithi089:Power on completed 2024-09-12T21:54:23.397 DEBUG:teuthology.orchestra.console.smithi089:Waiting for login prompt 2024-09-12T21:54:23.397 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi089 2024-09-12T21:54:25.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-09-12T21:54:31.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-09-12T21:54:37.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-09-12T21:54:42.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-09-12T21:54:48.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-09-12T21:54:54.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-09-12T21:55:00.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2024-09-12T21:55:06.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-09-12T21:55:11.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-09-12T21:55:17.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-09-12T21:55:23.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-09-12T21:55:29.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~81s 2024-09-12T21:55:35.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-09-12T21:55:40.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-09-12T21:55:46.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-09-12T21:55:52.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-09-12T21:55:58.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-09-12T21:56:04.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-09-12T21:56:09.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-09-12T21:56:15.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-09-12T21:56:17.313 DEBUG:teuthology.orchestra.console.smithi089:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D5 01 GUID: 00000000 0000 0000 0000 0CC47AD8A4C6 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.89 MASK 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.89 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d5:01)... Configuring (net0 0c:c4:7a:8f:d5:01).... Configuring (net0 0c:c4:7a:8f:d5:01)..... Configuring (net0 0c:c4:7a:8f:d5:01)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9         The selected entry will be started automatically in 4s.     Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e71fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f24000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.911 MHz processor [ 0.000410] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000414] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78e72 max_arch_pfn = 0x400000000 [ 0.006521] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006529] Using GB pages for direct mapping [ 0.006698] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006700] ACPI: Early table checksum verification disabled [ 0.006703] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006706] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006710] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006714] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006717] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006719] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006721] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006723] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006725] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006727] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006730] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006732] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006734] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006736] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006739] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006741] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006743] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006745] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006748] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006750] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006752] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006756] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006757] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006758] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006758] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006759] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006760] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006760] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006761] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006761] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006762] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006763] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006763] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006765] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006765] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006766] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006767] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006767] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006768] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006813] No NUMA configuration found [ 0.006814] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006823] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006993] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.007030] Zone ranges: [ 0.007030] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007032] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007033] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007034] Device empty [ 0.007034] Movable zone start for each node [ 0.007037] Early memory node ranges [ 0.007037] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007038] node 0: [mem 0x0000000000100000-0x0000000078e71fff] [ 0.007039] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007043] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007047] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007083] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011763] On node 0, zone Normal: 29070 pages in unavailable ranges [ 0.011873] ACPI: PM-Timer IO Port: 0x408 [ 0.011882] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011883] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011884] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011884] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011885] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011895] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011900] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011901] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011903] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011906] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011907] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011911] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011916] CPU topo: Max. logical packages: 1 [ 0.011917] CPU topo: Max. logical dies: 1 [ 0.011917] CPU topo: Max. dies per package: 1 [ 0.011921] CPU topo: Max. threads per core: 2 [ 0.011922] CPU topo: Num. cores per package: 4 [ 0.011923] CPU topo: Num. threads per package: 8 [ 0.011923] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011932] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011933] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011934] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011935] PM: hibernation: Registered nosave memory: [mem 0x78e72000-0x78f23fff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x78f24000-0x798adfff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011940] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011941] Booting paravirtualized kernel on bare hardware [ 0.011943] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016311] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016530] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016551] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016603] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016619] random: crng init done [ 0.018785] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019916] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020018] Fallback order for Node 0: 0 [ 0.020021] Built 1 zonelists, mobility grouping on. Total pages: 8228664 [ 0.020022] Policy zone: Normal [ 0.020163] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020170] software IO TLB: area num 8. [ 0.041105] Memory: 1751260K/33437680K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989840K reserved, 0K cma-reserved) [ 0.041208] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041216] Kernel/User page tables isolation: enabled [ 0.041240] ftrace: allocating 48134 entries in 189 pages [ 0.048096] ftrace: allocated 189 pages with 6 groups [ 0.048617] Dynamic Preempt: voluntary [ 0.048659] rcu: Preemptible hierarchical RCU implementation. [ 0.048660] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048661] Trampoline variant of Tasks RCU enabled. [ 0.048661] Rude variant of Tasks RCU enabled. [ 0.048661] Tracing variant of Tasks RCU enabled. [ 0.048662] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048663] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052128] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052290] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052397] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057639] Console: colour VGA+ 80x25 [ 0.057656] printk: console [ttyS1] enabled [ 1.112529] ACPI: Core revision 20230331 [ 1.116619] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.125749] APIC: Switch to symmetric I/O mode setup [ 1.130718] DMAR: Host address width 46 [ 1.134555] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.139871] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.147865] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.154132] DMAR: ATSR flags: 0x0 [ 1.157451] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.163718] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.170070] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.176424] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.181823] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.181824] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.196840] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.202140] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.208353] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.218751] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272fcf80f8, max_idle_ns: 440795261698 ns [ 1.229264] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.82 BogoMIPS (lpj=3499911) [ 1.230282] CPU0: Thermal monitoring enabled (TM1) [ 1.231317] process: using mwait in idle threads [ 1.232264] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.233263] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.234264] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.235264] Spectre V2 : Mitigation: Retpolines [ 1.237263] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.238263] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.239264] Speculative Store Bypass: Vulnerable [ 1.240268] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.241263] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.242263] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.243266] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.244263] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.245263] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.246263] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.247263] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.259814] Freeing SMP alternatives memory: 40K [ 1.260264] pid_max: default: 32768 minimum: 301 [ 1.261281] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.262268] Yama: becoming mindful. [ 1.263268] SELinux: Initializing. [ 1.264279] LSM support for eBPF active [ 1.265321] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.266301] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370222] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.371362] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.372275] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.373272] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.374271] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.375264] ... version: 3 [ 1.376263] ... bit width: 48 [ 1.377263] ... generic registers: 4 [ 1.378263] ... value mask: 0000ffffffffffff [ 1.379263] ... max period: 00007fffffffffff [ 1.380263] ... fixed-purpose events: 3 [ 1.381263] ... event mask: 000000070000000f [ 1.382349] signal: max sigframe size: 1776 [ 1.383274] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.384288] rcu: Hierarchical SRCU implementation. [ 1.384289] rcu: Max phase no-delay instances is 400. [ 1.387731] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.388330] smp: Bringing up secondary CPUs ... [ 1.389328] smpboot: x86: Booting SMP configuration: [ 1.389330] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.392518] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.392518] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.392518] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.397291] smp: Brought up 1 node, 8 CPUs [ 1.397291] smpboot: Total of 8 processors activated (55998.57 BogoMIPS) [ 1.436697] node 0 deferred pages initialised in 38ms [ 1.443290] devtmpfs: initialized [ 1.443292] x86/mm: Memory block size: 128MB [ 1.445280] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.445361] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.445364] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.445418] pinctrl core: initialized pinctrl subsystem [ 1.475453] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.475534] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.475538] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.475540] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.475546] audit: initializing netlink subsys (disabled) [ 1.475552] audit: type=2000 audit(1726178150.266:1): state=initialized audit_enabled=0 res=1 [ 1.475552] thermal_sys: Registered thermal governor 'fair_share' [ 1.475552] thermal_sys: Registered thermal governor 'step_wise' [ 1.475552] thermal_sys: Registered thermal governor 'user_space' [ 1.481265] cpuidle: using governor menu [ 1.486282] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.486283] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.486340] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.486343] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.486352] PCI: Using configuration type 1 for base access [ 1.515292] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.515298] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.515298] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.515298] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.515298] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.523403] cryptd: max_cpu_qlen set to 1000 [ 1.524346] ACPI: Added _OSI(Module Device) [ 1.524348] ACPI: Added _OSI(Processor Device) [ 1.524349] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.524349] ACPI: Added _OSI(Processor Aggregator Device) [ 1.524350] ACPI: Added _OSI(Linux-Dell-Video) [ 1.524351] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.524352] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.548167] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.551231] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.553357] ACPI: Dynamic OEM Table Load: [ 1.565910] ACPI: _OSC evaluated successfully for all CPUs [ 1.566169] ACPI: Interpreter enabled [ 1.566178] ACPI: PM: (supports S0 S4 S5) [ 1.566179] ACPI: Using IOAPIC for interrupt routing [ 1.567685] HEST: Enabling Firmware First mode for corrected errors. [ 1.608945] HEST: Table parsing has been initialized. [ 1.609063] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.609066] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.609067] PCI: Using E820 reservations for host bridge windows [ 1.609504] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.631130] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.631135] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.632253] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.632791] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.632792] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.632818] PCI host bridge to bus 0000:ff [ 1.632820] pci_bus 0000:ff: root bus resource [bus ff] [ 1.632830] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.632874] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.632907] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.632937] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.632968] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.632997] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.633028] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.633057] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.633088] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.633117] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.633147] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.633177] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.633207] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.633237] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.633270] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.633301] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.633330] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.633359] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.633388] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.633410] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.633446] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633508] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633568] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633627] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633687] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633746] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633805] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.633837] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.633870] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633912] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633955] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633997] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634038] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.634069] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.634101] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.634132] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.634165] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634207] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634251] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634296] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634339] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.634375] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.634406] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.634441] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.634475] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.634507] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.634539] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.634571] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.634605] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.634635] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.634666] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.634697] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.634719] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.634751] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.634782] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.637021] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.637025] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.637157] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.637401] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.637402] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.637811] PCI host bridge to bus 0000:00 [ 1.637812] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.637814] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.637815] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.637816] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.637817] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.637818] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.637819] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.637838] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.637943] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.637955] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.637992] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.638087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.638098] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.638101] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.638136] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.638226] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.638237] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.638239] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.638241] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.638245] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.638278] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.638366] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638373 pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.638451] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638459] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.638534] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638541] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.638619] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638626] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.638701] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638708] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.638782] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638789] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.638864] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638871] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.638949] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638956] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.639030] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639092] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639176] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639234] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.639239] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.639323] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.639565] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.639584] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.639595] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.639606] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.639617] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.639628] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.639641] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.639698] pci 0000:00:11.4: PME# supported from D3hot [ 1.639777] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.639800] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.639887] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.639978] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.640002] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.640090] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.640158] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.640181] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.641268] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.641356] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.641376] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.641490] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.641572] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.641610] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.641702] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.641804] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.641840] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.641846] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.641849] pci 0000:00:1c.2: bridge window [mem 0 1.641937] pci D0 D3hot D3cold [ 1.642038] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.642075] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.642080] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.642083] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.642170] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.642260] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642260] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.642260] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.642260] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.642260] pci 0000:00:1f063] [ 1.642[io 0xf050-0xf0.2: BAR 3 [io 0xf040-0xf043] [ 1.642260] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.642260] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.642260] pci 0000:00:1f.2: PME# supported from D3hot [ 1.642260] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.642260] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.642260] acpiphp: Slot [1] registered [ 1.642260] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.642260] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.642260] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.642260] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.642260] pci 0000:02:00.0: enabling Extended Tags [ 1.642361] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.642469] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.642479] pci 0000:03:00.0: BAR 0 [mem 0xfbd 1.642484] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.642494] pci 00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.642498] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.642536] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.642552] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642553] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.642562] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642563] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.642718] pci 03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.642728] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.642732] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.642742] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.642747] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.642784] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.642798] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642799] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.642807] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642808] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.642948] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.642994] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.643087] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.643159] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.643172] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.643177] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.643231] pci 0000:05:00.0: enabling Extended Tags [ 1.643355] pci 0000:05:00.0: supports D1 D2 [ 1.643355] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.643493] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.643580] pci_bus 0000:06: extended config space not accessible [ 1.643613] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.643650] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.643669] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.643689] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.643788] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.643858] pci 0000:06:00.0: supports D1 D2 [ 1.643858] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.644011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.644158] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.644192] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.644228] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.644247] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.645485] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.645549] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645550] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.645583] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645583] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.645926] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.645960] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.645996] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.646014] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.646243] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.646261] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646261] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.646261] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646261] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646261] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.646261] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.646332] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.646364] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.646394] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.646424] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.646454] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.646455] ACPI: PCI: Interrupt link LNKE disabled [ 1.646484] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.646485] ACPI: PCI: Interrupt link LNKF disabled [ 1.646515] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.646516] ACPI: PCI: Interrupt link LNKG disabled [ 1.646545] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.646546] ACPI: PCI: Interrupt link LNKH disabled [ 1.647278] iommu: Default domain type: Translated [ 1.647278] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.647344] SCSI subsystem initialized [ 1.647360] ACPI: bus type USB registered [ 1.647373] usbcore: registered new interface driver usbfs [ 1.647379] usbcore: registered new interface driver hub [ 1.647383] usbcore: registered new device driver usb [ 1.647402] pps_core: LinuxPPS API ver. 1 registered [ 1.647402] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.647405] PTP clock support registered [ 1.647418] EDAC MC: Ver: 3.0.0 [ 1.647420] NetLabel: Initializing [ 1.647420] NetLabel: domain hash size = 128 [ 1.647421] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.647434] NetLabel: unlabeled traffic allowed by default [ 1.647434] PCI: Using ACPI for IRQ routing [ 1.659284] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.659286] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.659286] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.659288] vgaarb: loaded [ 1.659294] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.659298] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.664273] clocksource: Switched to clocksource tsc-early [ 1.673381] VFS: Disk quotas dquot_6.6.0 [ 1.673389] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.673438] pnp: PnP ACPI init [ 1.673752] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.673754] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.673756] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.673757] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.673758] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.673759] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.673760] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.673761] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.673762] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.673763] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.673764] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.673765] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.673766] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.673915] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.673916] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.673918] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.673919] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.673920] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.674598] pnp: PnP ACPI: found 5 devices [ 1.680051] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.680100] NET: Registered PF_INET protocol family [ 1.680266] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.682531] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.682558] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.682564] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.682784] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.682892] TCP: Hash tables configured (established 262144 bind 65536) [ 1.683008] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.683090] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.683144] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.683219] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.683225] NET: Registered PF_XDP protocol family [ 1.683246] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.683257] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.683259] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.683264] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.683266] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.683272] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683273] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683275] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683275] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683277] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683278] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683279] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683280] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683281] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683282] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683283] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683284] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683285] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683286] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683288] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683288] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683290] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.683291] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.683293] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.683294] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.683298] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.683312] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.683314] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.683322] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.683338] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.683340] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.683345] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.683354] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.683363] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.683368] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.683375] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.683381] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.683382] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.683385] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.683389] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.683397] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.683398] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.683399] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.683400] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.683401] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.683402] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.683403] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.683404] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.683405] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.683405] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.683406] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.683407] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.683408] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.683409] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.683410] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.683411] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.683411] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.683412] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.683570] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.699990] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15868 usecs [ 1.711986] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11699 usecs [ 1.711998] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.712031] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.712032] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.712041] Trying to unpack rootfs image as initramfs... [ 1.712046] ACPI: bus type thunderbolt registered [ 1.870639] Initialise system trusted keyrings [ 1.870648] Key type blacklist registered [ 1.870691] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.870704] zbud: loaded [ 2.016892] integrity: Platform Keyring initialized [ 2.016897] integrity: Machine keyring initialized [ 2.024789] NET: Registered PF_ALG protocol family [ 2.024791] xor: automatically using best checksumming function avx [ 2.024793] Key type asymmetric registered [ 2.024794] Asymmetric key parser 'x509' registered [ 2.024795] Running certificate verification selftests [ 2.027082] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 2.028968] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 2.029053] io scheduler mq-deadline registered [ 2.029055] io scheduler kyber registered [ 2.029082] io scheduler bfq registered [ 2.029515] Freeing initrd memory: 31720K [ 2.105655] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.105996] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 2.106149] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 2.106291] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 2.106425] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 2.106571] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 2.106717] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 2.106873] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.124227] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.132819] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.132840] ACPI: button: Power Button [PWRB] [ 2.132862] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.132896] ACPI: button: Power Button [PWRF] [ 2.149553] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.149555] pstore: Registered erst as persistent store backend [ 2.149688] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.149789] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.157309] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.165938] Non-volatile memory driver v1.3 [ 2.174147] rdac: device handler registered [ 2.174170] hp_sw: device handler registered [ 2.174171] emc: device handler registered [ 2.174186] alua: device handler registered [ 2.174489] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.174529] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.174542] ehci-pci 0000:00:1d.0: debug port 2 [ 2.178460] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.184976] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.185008] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.185010] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.185011] usb usb1: Product: EHCI Host Controller [ 2.185012] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.185013] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.185099] hub 1-0:1.0: USB hub found [ 2.185103] hub 1-0:1.0: 2 ports detected [ 2.185230] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.185264] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.186342] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.186579] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.186583] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.186626] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.186628] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.186630] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.186644] ehci-pci 0000:00:1a.0: debug port 2 [ 2.186660] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.186662] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.186663] usb usb2: Product: xHCI Host Controller [ 2.186664] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.186665] usb usb2: SerialNumber: 0000:00:14.0 [ 2.186753] hub 2-0:1.0: USB hub found [ 2.186784] hub 2-0:1.0: 15 ports detected [ 2.189180] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.189183] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.189184] usb usb3: Product: xHCI Host Controller [ 2.189185] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.189185] usb usb3: SerialNumber: 0000:00:14.0 [ 2.189253] hub 3-0:1.0: USB hub found [ 2.189270] hub 3-0:1.0: 6 ports detected [ 2.190534] usbcore: registered new interface driver usbserial_generic [ 2.190539] usbserial: USB Serial support registered for generic [ 2.190570] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.190571] i8042: PNP: No PS/2 controller found. [ 2.190599] mousedev: PS/2 mouse device common for all mice [ 2.190656] rtc_cmos 00:00: RTC can wake from S4 [ 2.190926] rtc_cmos 00:00: registered as rtc0 [ 2.190975] rtc_cmos 00:00: setting system clock to 2024-09-12T21:55:52 UTC (1726178152) [ 2.190999] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.196954] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.196996] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.196998] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.196999] usb usb4: Product: EHCI Host Controller [ 2.197000] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.197001] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.197099] hub 4-0:1.0: USB hub found [ 2.197104] hub 4-0:1.0: 2 ports detected [ 2.198710] intel_pstate: Intel P-state driver initializing [ 2.292209] hid: raw HID events driver (C) Jiri Kosina [ 2.292239] usbcore: registered new interface driver usbhid [ 2.292239] usbhid: USB HID core driver [ 2.292265] drop_monitor: Initializing network drop monitor service [ 2.301744] Initializing XFRM netlink socket [ 2.301759] NET: Registered PF_INET6 protocol family [ 2.306545] Segment Routing with IPv6 [ 2.306563] NET: Registered PF_PACKET protocol family [ 2.306594] mpls_gso: MPLS GSO support [ 2.320113] microcode: Current revision: 0x0b000010 [ 2.340619] resctrl: L3 allocation detected [ 2.340620] resctrl: L3 monitoring detected [ 2.340632] IPI shorthand broadcast: enabled [ 2.340637] AVX2 version of gcm_enc/dec engaged. [ 2.385305] AES CTR mode by8 optimization enabled [ 2.385348] sched_clock: Marking stable (1228000625, 1156944138)->(2783325951, -398381188) [ 2.398771] registered taskstats version 1 [ 2.416732] Loading compiled-in X.509 certificates [ 2.417282] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.417546] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.417804] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.417939] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.417972] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.419703] page_owner is disabled [ 2.419885] pstore: Using crash dump compression: deflate [ 2.419896] Key type big_key registered [ 2.434978] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.435972] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.522976] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.552033] Key type encrypted registered [ 2.552038] ima: No TPM chip found, activating TPM-bypass! [ 2.552040] Loading compiled-in module X.509 certificates [ 2.552339] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.552342] ima: Allocated hash algorithm: sha256 [ 2.552350] ima: No architecture policies found [ 2.552357] evm: Initialising EVM extended attributes: [ 2.552357] evm: security.selinux [ 2.552358] evm: security.SMACK64 (disabled) [ 2.552358] evm: security.SMACK64EXEC (disabled) [ 2.552359] evm: security.SMACK64TRANSMUTE (disabled) [ 2.552359] evm: security.SMACK64MMAP (disabled) [ 2.552359] evm: security.apparmor (disabled) [ 2.552360] evm: security.ima [ 2.552360] evm: security.capability [ 2.552360] evm: HMAC attrs: 0x1 [ 2.566148] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.566151] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.566262] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.566265] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.566551] hub 4-1:1.0: USB hub found [ 2.566635] hub 4-1:1.0: 6 ports detected [ 2.566736] hub 2-12:1.0: USB hub found [ 2.566815] hub 2-12:1.0: 4 ports detected [ 2.654266] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.654268] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.654421] hub 1-1:1.0: USB hub found [ 2.654523] hub 1-1:1.0: 8 ports detected [ 2.724659] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.724680] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.730592] clocksource: Switched to clocksource tsc [ 2.860950] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.965223] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.965226] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.970262] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.022087] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.024719] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.024780] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.161191] clk: Disabling unused clocks [ 5.165981] Freeing unused decrypted memory: 2028K [ 5.171144] Freeing unused kernel image (initmem) memory: 3980K [ 5.171194] Write protecting the kernel read-only data: 30720k [ 5.183168] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.227613] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.227615] x86/mm: Checking user space page tables [ 5.263799] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.263807] Run /init as init process [ 5.276596] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.276696] systemd[1]: Detected architecture x86-64. [ 5.276698] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.327159] systemd[1]: Hostname set to . [ 5.383908] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.384062] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.406055] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.420016] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.432084] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.443078] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.455225] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.470098] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.484276] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.496084] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.510061] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.523015] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.541599] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.557082] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.569674] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.582620] systemd[1]: Starting Create System Users... Starting Creat[ 5.589213] fuse: init (API version 7.36) e System Users... [ 5.599894] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.612678] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook[ 5.987675] dca service started, version 1.12.1 ... Starting Show Plymouth Boot Screen... [ 6.026152] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.026158] igb: Copyright (c) 2007-2014 Intel Corporation. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requ[ 6.053496] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.053503] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ests to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.080234] igb 0000:07:00.0: added PHC on eth0 [ 6.080261] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.080262] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a4:c6 [ 6.080338] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.080339] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.112341] nvme nvme0: pci function 0000:02:00.0 [ 6.112581] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.112584] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.112586] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.114544] nvme nvme0: 8/0/0 default/read/poll queues [ 6.117094] ACPI: bus type drm_connector registered [ 6.126258] scsi host0: ahci [ 6.126414] scsi host1: ahci [ 6.126519] scsi host2: ahci [ 6.126647] scsi host3: ahci [ 6.126691] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 60 lpm-pol 0 [ 6.126695] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 60 lpm-pol 0 [ 6.126698] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 60 lpm-pol 0 [ 6.126702] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 60 lpm-pol 0 [ 6.127110] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.127113] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.127115] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.139418] igb 0000:07:00.1: added PHC on eth1 [ 6.139462] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.139463] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a4:c7 [ 6.139552] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.139553] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.149300] scsi host4: ahci [ 6.149386] scsi host5: ahci [ 6.149486] scsi host6: ahci [ 6.149596] scsi host7: ahci [ 6.149694] scsi host8: ahci [ 6.149791] scsi host9: ahci [ 6.149838] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 69 lpm-pol 0 [ 6.149843] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 69 lpm-pol 0 [ 6.149846] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 69 lpm-pol 0 [ 6.149849] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 69 lpm-pol 0 [ 6.149852] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 69 lpm-pol 0 [ 6.149856] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 69 lpm-pol 0 [ 6.430902] ata2: SATA link down (SStatus 0 SControl 300) [ 6.430929] ata4: SATA link down (SStatus 0 SControl 300) [ 6.430976] ata1: SATA link down (SStatus 0 SControl 300) [ 6.431009] ata3: SATA link down (SStatus 0 SControl 300) [ 6.454691] ata9: SATA link down (SStatus 0 SControl 300) [ 6.454908] ata10: SATA link down (SStatus 0 SControl 300) [ 6.454931] ata8: SATA link down (SStatus 0 SControl 300) [ 6.454956] ata7: SATA link down (SStatus 0 SControl 300) [ 6.454984] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.456037] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.456583] ata5.00: NCQ Send/Recv Log not supported [ 6.456585] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.456703] ata6: SATA link down (SStatus 0 SControl 300) [ 6.457993] ata5.00: NCQ Send/Recv Log not supported [ 6.457997] ata5.00: configured for UDMA/133 [ 6.458111] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.466784] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.510927] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.533702] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.533802] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.545133] Console: switching to colour dummy device 80x25 [ 6.545275] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.545277] ast 0000:06:00.0: AST 2400 detected [ 6.545321] ast 0000:06:00.0: [drm] Using analog VGA [ 6.545329] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.550928] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.556778] fbcon: astdrmfb (fb0) is primary device [ 6.585305] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.585322] sd 4:0:0:0: [sda] Write Protect is off [ 6.585345] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.585369] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.586752] Console: switching to colour frame buffer device 128x48 [ 6.593450] sda: sda1 [ 6.593568] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.603900] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.206242] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.206535] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.206617] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.206618] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d5:00 [ 7.208982] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.365166] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.365454] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.365536] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.365537] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d5:01 [ 7.368795] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.384466] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.409248] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.649900] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.986384] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). [ 8.493700] SELinux: policy capability network_peer_controls=1 [ 8.493708] SELinux: policy capability open_perms=1 [ 8.493709] SELinux: policy capability extended_socket_class=1 [ 8.493710] SELinux: policy capability always_check_network=0 [ 8.493711] SELinux: policy capability cgroup_seclabel=1 [ 8.493711] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493712] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.537407] audit: type=1403 audit(1726178158.845:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.543414] systemd[1]: Successfully loaded SELinux policy in 117.263ms. [ 8.622912] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.880ms. [ 8.630725] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.630836] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.678321] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.678442] systemd[1]: Stopped Switch Root. [ 9.685759] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.686067] systemd[1]: Created slice Slice /system/getty. [ 9.690060] systemd[1]: Created slice Slice /system/modprobe. [ 9.698905] systemd[1]: Created slice Slice /system/serial-getty. [ 9.704384] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.710141] systemd[1]: Created slice User and Session Slice. [ 9.715976] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.716074] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.723435] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.727740] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.742641] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.750192] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.759571] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.769902] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.780249] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.790568] systemd[1]: Reached target Local Encrypted Volumes. [ 9.800904] systemd[1]: Stopped target Switch Root. [ 9.811572] systemd[1]: Stopped target Initrd File Systems. [ 9.822503] systemd[1]: Stopped target Initrd Root File System. [ 9.828415] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.833308] systemd[1]: Reached target Path Units. [ 9.838856] systemd[1]: Reached target Slice Units. [ 9.844761] systemd[1]: Reached target Swaps. [ 9.851536] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.856660] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.862126] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Stopped Switch Root[ 9.887418] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.887482] systemd[1]: Reached target RPC Port Mapper. [ 9.896383] systemd[1]: Listening on Process Core Dump Socket. [ 9.900334] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.907107] systemd[1]: Listening on udev Control Socket. [ 9.912791] systemd[1]: Listening on udev Kernel Socket. [ 9.918792] systemd[1]: Mounting Huge Pages File System... [ 9.924078] systemd[1]: Mounting POSIX Message Queue File System... [ 9.929527] systemd[1]: Mounting Kernel Debug File System... [ 9.935759] systemd[1]: Mounting Kernel Trace File System... [ 9.940727] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). . [ OK ] Created slice [0;1;[ 9.962701] systemd[1]: Starting Create List of Static Device Nodes... [ 9.963525] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... 39mSlice /system[ 9.971046] systemd[1]: Starting Load Kernel Module configfs... [ 9.981242] systemd[1]: Starting Load Kernel Module drm... [ 9.988488] systemd[1]: Starting Load Kernel Module fuse... /getty. [ OK ] Created slice [ 10.001495] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... Slice /[ 10.011332] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.011378] systemd[1]: Stopped Plymouth switch root service. [ 10.020158] systemd[1]: Stopped Journal Service. system/modprobe[ 10.030906] systemd[1]: Starting Journal Service... [ 10.033604] systemd[1]: Starting Load Kernel Modules... [ 10.037364] systemd[1]: Starting Generate network units from Kernel command line... [ 10.041841] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.042749] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.049507] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.050615] systemd[1]: Starting Coldplug All udev Devices... [ 10.069129] systemd[1]: Mounted Huge Pages File System. [ 10.074812] systemd[1]: Mounted POSIX Message Queue File System. [ 10.084196] systemd[1]: Started Journal Service. [0m. [ OK ] Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch[ 10.131900] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. [0m. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root[0[ 10.219328] systemd-journald[577]: Received client request to flush runtime journal. m. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Cre[ 10.346522] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.346543] device-mapper: uevent: version 1.0.3 [ 10.346633] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ate List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.703854] IPMI message handler: version 39.2 [ 10.757423] ipmi device interface [ 10.767174] ipmi_si: IPMI System Interface driver [ 10.767191] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.767195] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.767197] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.767239] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.767312] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.767673] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.767675] ipmi_si: Adding ACPI-specified kcs state machine [ 10.767737] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.770166] power_meter ACPI000D:00: Found ACPI power meter. [ 10.770181] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.770185] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.839955] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.866339] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.877012] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.900426] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Finished [0[ 10.908750] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.909792] i2c i2c-3: 2/8 memory slots populated (from DMI) ;1;39mAutomatic [ 10.911028] igb 0000:07:00.0: DCA enabled [ 10.911047] igb 0000:07:00.1: DCA enabled Boot Loader Upda[ 10.930182] mei_me 0000:00:16.0: Device doesn't have valid ME Interface te. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.947959] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.947968] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.947972] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.961787] iTCO_vendor_support: vendor-support=0 [ 10.973275] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started [0;[ 10.979487] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) 1;39m/usr/sbin/l[ 10.980121] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) vm vgchange -aay --autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... [ 11.029100] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.272809] RPC: Registered named UNIX socket transport module. [ 11.272814] RPC: Registered udp transport module. [ 11.272817] RPC: Registered tcp transport module. [ 11.272818] RPC: Registered tcp-with-tls transport module. [ 11.272818] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK [[ 11.300464] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 11.300468] EDAC sbridge: Ver: 1.1.2 1;39mRPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.529789] intel_rapl_common: Found RAPL domain package [ 11.529800] intel_rapl_common: Found RAPL domain dram [ 11.539832] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.548487] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.548585] XFS (dm-4): Mounting V4 Filesystem fc7e8768-b81f-4f44-83b1-69d68945ea57 [ 11.552933] XFS (dm-4): Ending clean mount [ 11.552983] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.349451] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.497917] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.733011] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ 13.913071] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.913187] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.89 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 20.570929] block sda: the capability attribute has been deprecated. + '[' 172.21.15.89 '!=' '' ']' + set -e + '[' -n 172.21.15.89 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.89 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.89 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + newhostname=smithi089.front.sepia.ceph.com + '[' -n smithi089.front.sepia.ceph.com ']' + hostname smithi089.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi089 + echo smithi089 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.89 smithi089.front.sepia.ceph.com smithi089/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T21:56:17.314 DEBUG:teuthology.orchestra.console.smithi089:expect after: smithi089 login: 2024-09-12T21:56:17.367 DEBUG:teuthology.orchestra.console.smithi089:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D5 01 GUID: 00000000 0000 0000 0000 0CC47AD8A4C6 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.89 MASK 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.89 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d5:01)... Configuring (net0 0c:c4:7a:8f:d5:01).... Configuring (net0 0c:c4:7a:8f:d5:01)..... Configuring (net0 0c:c4:7a:8f:d5:01)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9         The selected entry will be started automatically in 4s.     Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e71fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f24000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.911 MHz processor [ 0.000410] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000414] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78e72 max_arch_pfn = 0x400000000 [ 0.006521] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006529] Using GB pages for direct mapping [ 0.006698] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006700] ACPI: Early table checksum verification disabled [ 0.006703] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006706] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006710] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006714] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006717] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006719] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006721] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006723] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006725] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006727] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006730] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006732] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006734] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006736] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006739] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006741] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006743] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006745] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006748] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006750] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006752] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006756] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006757] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006758] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006758] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006759] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006760] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006760] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006761] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006761] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006762] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006763] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006763] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006765] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006765] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006766] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006767] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006767] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006768] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006813] No NUMA configuration found [ 0.006814] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006823] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006993] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.007030] Zone ranges: [ 0.007030] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007032] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007033] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007034] Device empty [ 0.007034] Movable zone start for each node [ 0.007037] Early memory node ranges [ 0.007037] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007038] node 0: [mem 0x0000000000100000-0x0000000078e71fff] [ 0.007039] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007043] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007047] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007083] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011763] On node 0, zone Normal: 29070 pages in unavailable ranges [ 0.011873] ACPI: PM-Timer IO Port: 0x408 [ 0.011882] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011883] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011884] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011884] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011885] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011886] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011887] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011895] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011900] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011901] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011903] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011906] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011907] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011911] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011916] CPU topo: Max. logical packages: 1 [ 0.011917] CPU topo: Max. logical dies: 1 [ 0.011917] CPU topo: Max. dies per package: 1 [ 0.011921] CPU topo: Max. threads per core: 2 [ 0.011922] CPU topo: Num. cores per package: 4 [ 0.011923] CPU topo: Num. threads per package: 8 [ 0.011923] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011932] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011933] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011934] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011935] PM: hibernation: Registered nosave memory: [mem 0x78e72000-0x78f23fff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x78f24000-0x798adfff] [ 0.011936] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.011937] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011938] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011939] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011940] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011941] Booting paravirtualized kernel on bare hardware [ 0.011943] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016311] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016530] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016551] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016603] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016619] random: crng init done [ 0.018785] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019916] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020018] Fallback order for Node 0: 0 [ 0.020021] Built 1 zonelists, mobility grouping on. Total pages: 8228664 [ 0.020022] Policy zone: Normal [ 0.020163] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020170] software IO TLB: area num 8. [ 0.041105] Memory: 1751260K/33437680K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989840K reserved, 0K cma-reserved) [ 0.041208] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041216] Kernel/User page tables isolation: enabled [ 0.041240] ftrace: allocating 48134 entries in 189 pages [ 0.048096] ftrace: allocated 189 pages with 6 groups [ 0.048617] Dynamic Preempt: voluntary [ 0.048659] rcu: Preemptible hierarchical RCU implementation. [ 0.048660] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048661] Trampoline variant of Tasks RCU enabled. [ 0.048661] Rude variant of Tasks RCU enabled. [ 0.048661] Tracing variant of Tasks RCU enabled. [ 0.048662] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048663] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052128] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052290] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052397] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057639] Console: colour VGA+ 80x25 [ 0.057656] printk: console [ttyS1] enabled [ 1.112529] ACPI: Core revision 20230331 [ 1.116619] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.125749] APIC: Switch to symmetric I/O mode setup [ 1.130718] DMAR: Host address width 46 [ 1.134555] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.139871] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.147865] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.154132] DMAR: ATSR flags: 0x0 [ 1.157451] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.163718] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.170070] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.176424] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.181823] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.181824] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.196840] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.202140] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.208353] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.218751] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272fcf80f8, max_idle_ns: 440795261698 ns [ 1.229264] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.82 BogoMIPS (lpj=3499911) [ 1.230282] CPU0: Thermal monitoring enabled (TM1) [ 1.231317] process: using mwait in idle threads [ 1.232264] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.233263] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.234264] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.235264] Spectre V2 : Mitigation: Retpolines [ 1.237263] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.238263] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.239264] Speculative Store Bypass: Vulnerable [ 1.240268] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.241263] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.242263] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.243266] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.244263] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.245263] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.246263] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.247263] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.259814] Freeing SMP alternatives memory: 40K [ 1.260264] pid_max: default: 32768 minimum: 301 [ 1.261281] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.262268] Yama: becoming mindful. [ 1.263268] SELinux: Initializing. [ 1.264279] LSM support for eBPF active [ 1.265321] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.266301] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370222] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.371362] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.372275] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.373272] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.374271] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.375264] ... version: 3 [ 1.376263] ... bit width: 48 [ 1.377263] ... generic registers: 4 [ 1.378263] ... value mask: 0000ffffffffffff [ 1.379263] ... max period: 00007fffffffffff [ 1.380263] ... fixed-purpose events: 3 [ 1.381263] ... event mask: 000000070000000f [ 1.382349] signal: max sigframe size: 1776 [ 1.383274] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.384288] rcu: Hierarchical SRCU implementation. [ 1.384289] rcu: Max phase no-delay instances is 400. [ 1.387731] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.388330] smp: Bringing up secondary CPUs ... [ 1.389328] smpboot: x86: Booting SMP configuration: [ 1.389330] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.392518] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.392518] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.392518] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.397291] smp: Brought up 1 node, 8 CPUs [ 1.397291] smpboot: Total of 8 processors activated (55998.57 BogoMIPS) [ 1.436697] node 0 deferred pages initialised in 38ms [ 1.443290] devtmpfs: initialized [ 1.443292] x86/mm: Memory block size: 128MB [ 1.445280] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.445361] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.445364] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.445418] pinctrl core: initialized pinctrl subsystem [ 1.475453] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.475534] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.475538] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.475540] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.475546] audit: initializing netlink subsys (disabled) [ 1.475552] audit: type=2000 audit(1726178150.266:1): state=initialized audit_enabled=0 res=1 [ 1.475552] thermal_sys: Registered thermal governor 'fair_share' [ 1.475552] thermal_sys: Registered thermal governor 'step_wise' [ 1.475552] thermal_sys: Registered thermal governor 'user_space' [ 1.481265] cpuidle: using governor menu [ 1.486282] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.486283] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.486340] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.486343] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.486352] PCI: Using configuration type 1 for base access [ 1.515292] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.515298] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.515298] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.515298] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.515298] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.523403] cryptd: max_cpu_qlen set to 1000 [ 1.524346] ACPI: Added _OSI(Module Device) [ 1.524348] ACPI: Added _OSI(Processor Device) [ 1.524349] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.524349] ACPI: Added _OSI(Processor Aggregator Device) [ 1.524350] ACPI: Added _OSI(Linux-Dell-Video) [ 1.524351] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.524352] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.548167] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.551231] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.553357] ACPI: Dynamic OEM Table Load: [ 1.565910] ACPI: _OSC evaluated successfully for all CPUs [ 1.566169] ACPI: Interpreter enabled [ 1.566178] ACPI: PM: (supports S0 S4 S5) [ 1.566179] ACPI: Using IOAPIC for interrupt routing [ 1.567685] HEST: Enabling Firmware First mode for corrected errors. [ 1.608945] HEST: Table parsing has been initialized. [ 1.609063] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.609066] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.609067] PCI: Using E820 reservations for host bridge windows [ 1.609504] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.631130] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.631135] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.632253] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.632791] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.632792] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.632818] PCI host bridge to bus 0000:ff [ 1.632820] pci_bus 0000:ff: root bus resource [bus ff] [ 1.632830] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.632874] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.632907] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.632937] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.632968] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.632997] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.633028] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.633057] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.633088] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.633117] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.633147] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.633177] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.633207] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.633237] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.633270] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.633301] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.633330] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.633359] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.633388] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.633410] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.633446] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633508] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633568] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633627] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633687] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633746] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633805] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.633837] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.633870] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633912] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633955] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.633997] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634038] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.634069] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.634101] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.634132] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.634165] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634207] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634251] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634296] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.634339] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.634375] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.634406] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.634441] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.634475] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.634507] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.634539] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.634571] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.634605] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.634635] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.634666] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.634697] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.634719] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.634751] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.634782] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.637021] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.637025] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.637157] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.637401] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.637402] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.637811] PCI host bridge to bus 0000:00 [ 1.637812] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.637814] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.637815] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.637816] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.637817] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.637818] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.637819] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.637838] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.637943] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.637955] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.637992] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.638087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.638098] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.638101] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.638136] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.638226] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.638237] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.638239] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.638241] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.638245] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.638278] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.638366] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638373 pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.638451] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638459] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.638534] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638541] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.638619] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638626] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.638701] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638708] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.638782] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638789] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.638864] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638871] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.638949] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.638956] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.639030] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639092] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639176] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.639234] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.639239] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.639323] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.639565] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.639584] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.639595] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.639606] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.639617] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.639628] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.639641] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.639698] pci 0000:00:11.4: PME# supported from D3hot [ 1.639777] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.639800] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.639887] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.639978] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.640002] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.640090] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.640158] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.640181] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.641268] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.641356] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.641376] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.641490] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.641572] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.641610] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.641702] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.641804] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.641840] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.641846] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.641849] pci 0000:00:1c.2: bridge window [mem 0 1.641937] pci D0 D3hot D3cold [ 1.642038] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.642075] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.642080] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.642083] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.642170] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.642260] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642260] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.642260] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.642260] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.642260] pci 0000:00:1f063] [ 1.642[io 0xf050-0xf0.2: BAR 3 [io 0xf040-0xf043] [ 1.642260] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.642260] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.642260] pci 0000:00:1f.2: PME# supported from D3hot [ 1.642260] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.642260] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.642260] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.642260] acpiphp: Slot [1] registered [ 1.642260] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.642260] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.642260] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.642260] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.642260] pci 0000:02:00.0: enabling Extended Tags [ 1.642361] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.642469] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.642479] pci 0000:03:00.0: BAR 0 [mem 0xfbd 1.642484] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.642494] pci 00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.642498] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.642536] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.642552] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642553] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.642562] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642563] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.642718] pci 03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.642728] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.642732] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.642742] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.642747] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.642784] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.642798] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642799] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.642807] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.642808] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.642948] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.642994] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.643087] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.643159] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.643172] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.643177] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.643231] pci 0000:05:00.0: enabling Extended Tags [ 1.643355] pci 0000:05:00.0: supports D1 D2 [ 1.643355] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.643493] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.643580] pci_bus 0000:06: extended config space not accessible [ 1.643613] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.643650] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.643669] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.643689] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.643788] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.643858] pci 0000:06:00.0: supports D1 D2 [ 1.643858] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.644011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.644158] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.644192] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.644228] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.644247] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.645485] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.645549] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645550] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.645583] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645583] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.645926] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.645960] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.645996] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.646014] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.646243] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.646261] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646261] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.646261] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.646261] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.646261] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.646261] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.646332] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.646364] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.646394] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.646424] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.646454] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.646455] ACPI: PCI: Interrupt link LNKE disabled [ 1.646484] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.646485] ACPI: PCI: Interrupt link LNKF disabled [ 1.646515] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.646516] ACPI: PCI: Interrupt link LNKG disabled [ 1.646545] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.646546] ACPI: PCI: Interrupt link LNKH disabled [ 1.647278] iommu: Default domain type: Translated [ 1.647278] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.647344] SCSI subsystem initialized [ 1.647360] ACPI: bus type USB registered [ 1.647373] usbcore: registered new interface driver usbfs [ 1.647379] usbcore: registered new interface driver hub [ 1.647383] usbcore: registered new device driver usb [ 1.647402] pps_core: LinuxPPS API ver. 1 registered [ 1.647402] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.647405] PTP clock support registered [ 1.647418] EDAC MC: Ver: 3.0.0 [ 1.647420] NetLabel: Initializing [ 1.647420] NetLabel: domain hash size = 128 [ 1.647421] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.647434] NetLabel: unlabeled traffic allowed by default [ 1.647434] PCI: Using ACPI for IRQ routing [ 1.659284] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.659286] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.659286] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.659288] vgaarb: loaded [ 1.659294] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.659298] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.664273] clocksource: Switched to clocksource tsc-early [ 1.673381] VFS: Disk quotas dquot_6.6.0 [ 1.673389] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.673438] pnp: PnP ACPI init [ 1.673752] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.673754] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.673756] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.673757] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.673758] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.673759] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.673760] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.673761] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.673762] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.673763] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.673764] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.673765] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.673766] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.673915] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.673916] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.673918] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.673919] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.673920] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.674598] pnp: PnP ACPI: found 5 devices [ 1.680051] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.680100] NET: Registered PF_INET protocol family [ 1.680266] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.682531] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.682558] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.682564] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.682784] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.682892] TCP: Hash tables configured (established 262144 bind 65536) [ 1.683008] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.683090] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.683144] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.683219] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.683225] NET: Registered PF_XDP protocol family [ 1.683246] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.683257] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.683259] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.683264] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.683266] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.683272] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683273] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683275] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683275] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683277] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683278] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683279] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683280] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683281] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683282] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683283] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683284] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683285] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683286] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683288] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.683288] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.683290] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.683291] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.683293] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.683294] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.683298] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.683312] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.683314] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.683322] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.683338] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.683340] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.683345] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.683354] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.683363] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.683368] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.683375] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.683381] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.683382] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.683385] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.683389] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.683397] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.683398] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.683399] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.683400] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.683401] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.683402] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.683403] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.683404] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.683405] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.683405] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.683406] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.683407] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.683408] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.683409] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.683410] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.683411] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.683411] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.683412] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.683570] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.699990] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15868 usecs [ 1.711986] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11699 usecs [ 1.711998] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.712031] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.712032] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.712041] Trying to unpack rootfs image as initramfs... [ 1.712046] ACPI: bus type thunderbolt registered [ 1.870639] Initialise system trusted keyrings [ 1.870648] Key type blacklist registered [ 1.870691] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.870704] zbud: loaded [ 2.016892] integrity: Platform Keyring initialized [ 2.016897] integrity: Machine keyring initialized [ 2.024789] NET: Registered PF_ALG protocol family [ 2.024791] xor: automatically using best checksumming function avx [ 2.024793] Key type asymmetric registered [ 2.024794] Asymmetric key parser 'x509' registered [ 2.024795] Running certificate verification selftests [ 2.027082] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 2.028968] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 2.029053] io scheduler mq-deadline registered [ 2.029055] io scheduler kyber registered [ 2.029082] io scheduler bfq registered [ 2.029515] Freeing initrd memory: 31720K [ 2.105655] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.105996] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 2.106149] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 2.106291] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 2.106425] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 2.106571] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 2.106717] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 2.106873] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.124227] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.132819] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.132840] ACPI: button: Power Button [PWRB] [ 2.132862] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.132896] ACPI: button: Power Button [PWRF] [ 2.149553] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.149555] pstore: Registered erst as persistent store backend [ 2.149688] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.149789] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.157309] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.165938] Non-volatile memory driver v1.3 [ 2.174147] rdac: device handler registered [ 2.174170] hp_sw: device handler registered [ 2.174171] emc: device handler registered [ 2.174186] alua: device handler registered [ 2.174489] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.174529] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.174542] ehci-pci 0000:00:1d.0: debug port 2 [ 2.178460] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.184976] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.185008] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.185010] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.185011] usb usb1: Product: EHCI Host Controller [ 2.185012] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.185013] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.185099] hub 1-0:1.0: USB hub found [ 2.185103] hub 1-0:1.0: 2 ports detected [ 2.185230] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.185264] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.186342] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.186579] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.186583] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.186626] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.186628] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.186630] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.186644] ehci-pci 0000:00:1a.0: debug port 2 [ 2.186660] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.186662] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.186663] usb usb2: Product: xHCI Host Controller [ 2.186664] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.186665] usb usb2: SerialNumber: 0000:00:14.0 [ 2.186753] hub 2-0:1.0: USB hub found [ 2.186784] hub 2-0:1.0: 15 ports detected [ 2.189180] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.189183] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.189184] usb usb3: Product: xHCI Host Controller [ 2.189185] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.189185] usb usb3: SerialNumber: 0000:00:14.0 [ 2.189253] hub 3-0:1.0: USB hub found [ 2.189270] hub 3-0:1.0: 6 ports detected [ 2.190534] usbcore: registered new interface driver usbserial_generic [ 2.190539] usbserial: USB Serial support registered for generic [ 2.190570] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.190571] i8042: PNP: No PS/2 controller found. [ 2.190599] mousedev: PS/2 mouse device common for all mice [ 2.190656] rtc_cmos 00:00: RTC can wake from S4 [ 2.190926] rtc_cmos 00:00: registered as rtc0 [ 2.190975] rtc_cmos 00:00: setting system clock to 2024-09-12T21:55:52 UTC (1726178152) [ 2.190999] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.196954] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.196996] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.196998] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.196999] usb usb4: Product: EHCI Host Controller [ 2.197000] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.197001] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.197099] hub 4-0:1.0: USB hub found [ 2.197104] hub 4-0:1.0: 2 ports detected [ 2.198710] intel_pstate: Intel P-state driver initializing [ 2.292209] hid: raw HID events driver (C) Jiri Kosina [ 2.292239] usbcore: registered new interface driver usbhid [ 2.292239] usbhid: USB HID core driver [ 2.292265] drop_monitor: Initializing network drop monitor service [ 2.301744] Initializing XFRM netlink socket [ 2.301759] NET: Registered PF_INET6 protocol family [ 2.306545] Segment Routing with IPv6 [ 2.306563] NET: Registered PF_PACKET protocol family [ 2.306594] mpls_gso: MPLS GSO support [ 2.320113] microcode: Current revision: 0x0b000010 [ 2.340619] resctrl: L3 allocation detected [ 2.340620] resctrl: L3 monitoring detected [ 2.340632] IPI shorthand broadcast: enabled [ 2.340637] AVX2 version of gcm_enc/dec engaged. [ 2.385305] AES CTR mode by8 optimization enabled [ 2.385348] sched_clock: Marking stable (1228000625, 1156944138)->(2783325951, -398381188) [ 2.398771] registered taskstats version 1 [ 2.416732] Loading compiled-in X.509 certificates [ 2.417282] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.417546] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.417804] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.417939] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.417972] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.419703] page_owner is disabled [ 2.419885] pstore: Using crash dump compression: deflate [ 2.419896] Key type big_key registered [ 2.434978] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.435972] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.522976] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.552033] Key type encrypted registered [ 2.552038] ima: No TPM chip found, activating TPM-bypass! [ 2.552040] Loading compiled-in module X.509 certificates [ 2.552339] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.552342] ima: Allocated hash algorithm: sha256 [ 2.552350] ima: No architecture policies found [ 2.552357] evm: Initialising EVM extended attributes: [ 2.552357] evm: security.selinux [ 2.552358] evm: security.SMACK64 (disabled) [ 2.552358] evm: security.SMACK64EXEC (disabled) [ 2.552359] evm: security.SMACK64TRANSMUTE (disabled) [ 2.552359] evm: security.SMACK64MMAP (disabled) [ 2.552359] evm: security.apparmor (disabled) [ 2.552360] evm: security.ima [ 2.552360] evm: security.capability [ 2.552360] evm: HMAC attrs: 0x1 [ 2.566148] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.566151] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.566262] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.566265] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.566551] hub 4-1:1.0: USB hub found [ 2.566635] hub 4-1:1.0: 6 ports detected [ 2.566736] hub 2-12:1.0: USB hub found [ 2.566815] hub 2-12:1.0: 4 ports detected [ 2.654266] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.654268] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.654421] hub 1-1:1.0: USB hub found [ 2.654523] hub 1-1:1.0: 8 ports detected [ 2.724659] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.724680] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.730592] clocksource: Switched to clocksource tsc [ 2.860950] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.965223] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.965226] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.970262] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.022087] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.024719] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.024780] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.161191] clk: Disabling unused clocks [ 5.165981] Freeing unused decrypted memory: 2028K [ 5.171144] Freeing unused kernel image (initmem) memory: 3980K [ 5.171194] Write protecting the kernel read-only data: 30720k [ 5.183168] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.227613] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.227615] x86/mm: Checking user space page tables [ 5.263799] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.263807] Run /init as init process [ 5.276596] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.276696] systemd[1]: Detected architecture x86-64. [ 5.276698] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.327159] systemd[1]: Hostname set to . [ 5.383908] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.384062] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.406055] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.420016] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.432084] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.443078] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.455225] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.470098] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.484276] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.496084] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.510061] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.523015] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.541599] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.557082] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.569674] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.582620] systemd[1]: Starting Create System Users... Starting Creat[ 5.589213] fuse: init (API version 7.36) e System Users... [ 5.599894] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.612678] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook[ 5.987675] dca service started, version 1.12.1 ... Starting Show Plymouth Boot Screen... [ 6.026152] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.026158] igb: Copyright (c) 2007-2014 Intel Corporation. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requ[ 6.053496] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.053503] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ests to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.080234] igb 0000:07:00.0: added PHC on eth0 [ 6.080261] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.080262] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a4:c6 [ 6.080338] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.080339] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.112341] nvme nvme0: pci function 0000:02:00.0 [ 6.112581] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.112584] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.112586] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.114544] nvme nvme0: 8/0/0 default/read/poll queues [ 6.117094] ACPI: bus type drm_connector registered [ 6.126258] scsi host0: ahci [ 6.126414] scsi host1: ahci [ 6.126519] scsi host2: ahci [ 6.126647] scsi host3: ahci [ 6.126691] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 60 lpm-pol 0 [ 6.126695] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 60 lpm-pol 0 [ 6.126698] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 60 lpm-pol 0 [ 6.126702] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 60 lpm-pol 0 [ 6.127110] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 6.127113] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.127115] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.139418] igb 0000:07:00.1: added PHC on eth1 [ 6.139462] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.139463] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a4:c7 [ 6.139552] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.139553] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.149300] scsi host4: ahci [ 6.149386] scsi host5: ahci [ 6.149486] scsi host6: ahci [ 6.149596] scsi host7: ahci [ 6.149694] scsi host8: ahci [ 6.149791] scsi host9: ahci [ 6.149838] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 69 lpm-pol 0 [ 6.149843] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 69 lpm-pol 0 [ 6.149846] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 69 lpm-pol 0 [ 6.149849] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 69 lpm-pol 0 [ 6.149852] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 69 lpm-pol 0 [ 6.149856] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 69 lpm-pol 0 [ 6.430902] ata2: SATA link down (SStatus 0 SControl 300) [ 6.430929] ata4: SATA link down (SStatus 0 SControl 300) [ 6.430976] ata1: SATA link down (SStatus 0 SControl 300) [ 6.431009] ata3: SATA link down (SStatus 0 SControl 300) [ 6.454691] ata9: SATA link down (SStatus 0 SControl 300) [ 6.454908] ata10: SATA link down (SStatus 0 SControl 300) [ 6.454931] ata8: SATA link down (SStatus 0 SControl 300) [ 6.454956] ata7: SATA link down (SStatus 0 SControl 300) [ 6.454984] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.456037] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.456583] ata5.00: NCQ Send/Recv Log not supported [ 6.456585] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.456703] ata6: SATA link down (SStatus 0 SControl 300) [ 6.457993] ata5.00: NCQ Send/Recv Log not supported [ 6.457997] ata5.00: configured for UDMA/133 [ 6.458111] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.466784] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.510927] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.533702] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.533802] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.545133] Console: switching to colour dummy device 80x25 [ 6.545275] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.545277] ast 0000:06:00.0: AST 2400 detected [ 6.545321] ast 0000:06:00.0: [drm] Using analog VGA [ 6.545329] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.550928] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.556778] fbcon: astdrmfb (fb0) is primary device [ 6.585305] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.585322] sd 4:0:0:0: [sda] Write Protect is off [ 6.585345] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.585369] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.586752] Console: switching to colour frame buffer device 128x48 [ 6.593450] sda: sda1 [ 6.593568] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.603900] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.206242] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.206535] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.206617] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.206618] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d5:00 [ 7.208982] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.365166] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.365454] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.365536] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.365537] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d5:01 [ 7.368795] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.384466] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.409248] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.649900] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.986384] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). [ 8.493700] SELinux: policy capability network_peer_controls=1 [ 8.493708] SELinux: policy capability open_perms=1 [ 8.493709] SELinux: policy capability extended_socket_class=1 [ 8.493710] SELinux: policy capability always_check_network=0 [ 8.493711] SELinux: policy capability cgroup_seclabel=1 [ 8.493711] SELinux: policy capability nnp_nosuid_transition=1 [ 8.493712] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.537407] audit: type=1403 audit(1726178158.845:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.543414] systemd[1]: Successfully loaded SELinux policy in 117.263ms. [ 8.622912] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.880ms. [ 8.630725] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.630836] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.678321] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.678442] systemd[1]: Stopped Switch Root. [ 9.685759] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.686067] systemd[1]: Created slice Slice /system/getty. [ 9.690060] systemd[1]: Created slice Slice /system/modprobe. [ 9.698905] systemd[1]: Created slice Slice /system/serial-getty. [ 9.704384] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.710141] systemd[1]: Created slice User and Session Slice. [ 9.715976] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.716074] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.723435] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.727740] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.742641] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.750192] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.759571] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.769902] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.780249] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.790568] systemd[1]: Reached target Local Encrypted Volumes. [ 9.800904] systemd[1]: Stopped target Switch Root. [ 9.811572] systemd[1]: Stopped target Initrd File Systems. [ 9.822503] systemd[1]: Stopped target Initrd Root File System. [ 9.828415] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.833308] systemd[1]: Reached target Path Units. [ 9.838856] systemd[1]: Reached target Slice Units. [ 9.844761] systemd[1]: Reached target Swaps. [ 9.851536] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.856660] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.862126] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Stopped Switch Root[ 9.887418] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.887482] systemd[1]: Reached target RPC Port Mapper. [ 9.896383] systemd[1]: Listening on Process Core Dump Socket. [ 9.900334] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.907107] systemd[1]: Listening on udev Control Socket. [ 9.912791] systemd[1]: Listening on udev Kernel Socket. [ 9.918792] systemd[1]: Mounting Huge Pages File System... [ 9.924078] systemd[1]: Mounting POSIX Message Queue File System... [ 9.929527] systemd[1]: Mounting Kernel Debug File System... [ 9.935759] systemd[1]: Mounting Kernel Trace File System... [ 9.940727] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). . [ OK ] Created slice [0;1;[ 9.962701] systemd[1]: Starting Create List of Static Device Nodes... [ 9.963525] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... 39mSlice /system[ 9.971046] systemd[1]: Starting Load Kernel Module configfs... [ 9.981242] systemd[1]: Starting Load Kernel Module drm... [ 9.988488] systemd[1]: Starting Load Kernel Module fuse... /getty. [ OK ] Created slice [ 10.001495] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... Slice /[ 10.011332] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.011378] systemd[1]: Stopped Plymouth switch root service. [ 10.020158] systemd[1]: Stopped Journal Service. system/modprobe[ 10.030906] systemd[1]: Starting Journal Service... [ 10.033604] systemd[1]: Starting Load Kernel Modules... [ 10.037364] systemd[1]: Starting Generate network units from Kernel command line... [ 10.041841] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.042749] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.049507] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.050615] systemd[1]: Starting Coldplug All udev Devices... [ 10.069129] systemd[1]: Mounted Huge Pages File System. [ 10.074812] systemd[1]: Mounted POSIX Message Queue File System. [ 10.084196] systemd[1]: Started Journal Service. [0m. [ OK ] Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch[ 10.131900] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. [0m. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root[0[ 10.219328] systemd-journald[577]: Received client request to flush runtime journal. m. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Cre[ 10.346522] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.346543] device-mapper: uevent: version 1.0.3 [ 10.346633] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ate List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.703854] IPMI message handler: version 39.2 [ 10.757423] ipmi device interface [ 10.767174] ipmi_si: IPMI System Interface driver [ 10.767191] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.767195] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.767197] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.767239] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.767312] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.767673] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.767675] ipmi_si: Adding ACPI-specified kcs state machine [ 10.767737] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.770166] power_meter ACPI000D:00: Found ACPI power meter. [ 10.770181] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.770185] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.839955] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.866339] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.877012] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.900426] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Finished [0[ 10.908750] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.909792] i2c i2c-3: 2/8 memory slots populated (from DMI) ;1;39mAutomatic [ 10.911028] igb 0000:07:00.0: DCA enabled [ 10.911047] igb 0000:07:00.1: DCA enabled Boot Loader Upda[ 10.930182] mei_me 0000:00:16.0: Device doesn't have valid ME Interface te. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.947959] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.947968] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.947972] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.961787] iTCO_vendor_support: vendor-support=0 [ 10.973275] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started [0;[ 10.979487] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) 1;39m/usr/sbin/l[ 10.980121] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) vm vgchange -aay --autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... [ 11.029100] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.272809] RPC: Registered named UNIX socket transport module. [ 11.272814] RPC: Registered udp transport module. [ 11.272817] RPC: Registered tcp transport module. [ 11.272818] RPC: Registered tcp-with-tls transport module. [ 11.272818] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK [[ 11.300464] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) 0m] Mounted [0;[ 11.300468] EDAC sbridge: Ver: 1.1.2 1;39mRPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.529789] intel_rapl_common: Found RAPL domain package [ 11.529800] intel_rapl_common: Found RAPL domain dram [ 11.539832] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.548487] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.548585] XFS (dm-4): Mounting V4 Filesystem fc7e8768-b81f-4f44-83b1-69d68945ea57 [ 11.552933] XFS (dm-4): Ending clean mount [ 11.552983] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.349451] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.497917] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.733011] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ 13.913071] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.913187] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.89 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 20.570929] block sda: the capability attribute has been deprecated. + '[' 172.21.15.89 '!=' '' ']' + set -e + '[' -n 172.21.15.89 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.89 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.89 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + newhostname=smithi089.front.sepia.ceph.com + '[' -n smithi089.front.sepia.ceph.com ']' + hostname smithi089.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi089 + echo smithi089 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.89 smithi089.front.sepia.ceph.com smithi089/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi089 login: [disconnect] 2024-09-12T21:56:17.469 INFO:teuthology.misc:Re-opening connections... 2024-09-12T21:56:17.469 INFO:teuthology.misc:trying to connect to ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:56:17.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:56:17.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:56:17.778 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-12T21:56:18.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-12T21:56:18.203 DEBUG:teuthology.misc:waited 0.7342901229858398 2024-09-12T21:56:19.204 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:56:19.205 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi089.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-09-12T21:56:19.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T21:56:19.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T21:56:19.462 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T21:56:19.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T21:56:19.465 INFO:tasks.ceph.osd.0:Started 2024-09-12T21:56:19.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:56:19.645 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T21:56:19.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:56:19.649 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T21:56:21.577 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:56:21.575+0000 7fc2fff34640 -1 Falling back to public interface 2024-09-12T21:56:21.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T21:56:24.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:56:24.754 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-12T21:56:24.754 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-12T21:56:24.754 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-12T21:56:24.754 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-12T21:56:24.754 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs debug_inject_read_zeros 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs files list 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs stats 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore bluefs device info [] 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:config diff 2024-09-12T21:56:24.755 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-12T21:56:24.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:56:24.757 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T21:56:29.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:no valid command found; 10 closest matches: 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:0 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:1 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:2 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:abort 2024-09-12T21:56:29.859 INFO:teuthology.orchestra.run.smithi089.stderr:assert 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs debug_inject_read_zeros 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs files list 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:bluefs stats 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator dump block 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:bluestore allocator fragmentation block 2024-09-12T21:56:29.860 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: invalid command 2024-09-12T21:56:29.861 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T21:56:29.862 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T21:56:30.784 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:56:30.782+0000 7fc2fff34640 -1 osd.0 76 log_to_monitors true 2024-09-12T21:56:31.331 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-09-12T21:56:31.330+0000 7fc2f3cd2640 -1 osd.0 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T21:56:34.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T21:56:34.977 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-12T21:56:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "ops": [], 2024-09-12T21:56:34.978 INFO:teuthology.orchestra.run.smithi089.stdout: "num_ops": 0 2024-09-12T21:56:34.978 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-12T21:56:34.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T21:56:35.117 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a: {} 2024-09-12T21:56:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:56:35.126 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b: {} 2024-09-12T21:56:35.126 INFO:teuthology.orchestra.run.smithi053.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:56:35.135 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c: {} 2024-09-12T21:56:35.135 INFO:teuthology.orchestra.run.smithi053.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T21:56:35.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T21:56:36.320 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T21:56:36.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T21:56:37.327 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T21:56:37.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T21:56:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T21:56:38.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T21:56:39.338 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T21:56:39.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T21:56:40.348 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T21:56:40.365 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T21:56:41.349 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T21:56:41.367 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T21:56:41.367 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T21:56:41.367 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T21:56:41.367 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T21:56:41.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T21:56:41.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:56:41.663 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:41.663 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":87,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:56:41.347803+0000","last_up_change":"2024-09-12T21:56:32.306559+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6801","nonce":908289176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6803","nonce":908289176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6807","nonce":908289176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6805","nonce":908289176}]},"public_addr":"172.21.15.89:6801/908289176","cluster_addr":"172.21.15.89:6803/908289176","heartbeat_back_addr":"172.21.15.89:6807/908289176","heartbeat_front_addr":"172.21.15.89:6805/908289176","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":72,"up_thru":80,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6801","nonce":427257840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6803","nonce":427257840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6807","nonce":427257840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6805","nonce":427257840}]},"public_addr":"172.21.15.172:6801/427257840","cluster_addr":"172.21.15.172:6803/427257840","heartbeat_back_addr":"172.21.15.172:6807/427257840","heartbeat_front_addr":"172.21.15.172:6805/427257840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":32}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:56:41.676 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T21:56:41.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:56:41.968 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:41.968 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":87,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:56:41.347803+0000","last_up_change":"2024-09-12T21:56:32.306559+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6801","nonce":908289176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6803","nonce":908289176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6807","nonce":908289176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6805","nonce":908289176}]},"public_addr":"172.21.15.89:6801/908289176","cluster_addr":"172.21.15.89:6803/908289176","heartbeat_back_addr":"172.21.15.89:6807/908289176","heartbeat_front_addr":"172.21.15.89:6805/908289176","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":72,"up_thru":80,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6801","nonce":427257840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6803","nonce":427257840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6807","nonce":427257840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6805","nonce":427257840}]},"public_addr":"172.21.15.172:6801/427257840","cluster_addr":"172.21.15.172:6803/427257840","heartbeat_back_addr":"172.21.15.172:6807/427257840","heartbeat_front_addr":"172.21.15.172:6805/427257840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":32}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:56:41.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T21:56:41.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T21:56:41.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T21:56:42.123 INFO:teuthology.orchestra.run.smithi053.stdout:309237645347 2024-09-12T21:56:42.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T21:56:42.145 INFO:teuthology.orchestra.run.smithi053.stdout:34359738446 2024-09-12T21:56:42.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T21:56:42.146 INFO:teuthology.orchestra.run.smithi053.stdout:343597383684 2024-09-12T21:56:42.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T21:56:42.431 INFO:teuthology.orchestra.run.smithi053.stdout:309237645345 2024-09-12T21:56:42.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645347 got 309237645345 for osd.2 2024-09-12T21:56:42.508 INFO:teuthology.orchestra.run.smithi053.stdout:34359738445 2024-09-12T21:56:42.513 INFO:teuthology.orchestra.run.smithi053.stdout:343597383682 2024-09-12T21:56:42.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738446 got 34359738445 for osd.1 2024-09-12T21:56:42.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383684 got 343597383682 for osd.0 2024-09-12T21:56:43.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T21:56:43.524 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T21:56:43.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T21:56:43.762 INFO:teuthology.orchestra.run.smithi053.stdout:309237645347 2024-09-12T21:56:43.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645347 got 309237645347 for osd.2 2024-09-12T21:56:43.776 DEBUG:teuthology.parallel:result is None 2024-09-12T21:56:43.830 INFO:teuthology.orchestra.run.smithi053.stdout:34359738446 2024-09-12T21:56:43.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738446 got 34359738446 for osd.1 2024-09-12T21:56:43.843 DEBUG:teuthology.parallel:result is None 2024-09-12T21:56:43.867 INFO:teuthology.orchestra.run.smithi053.stdout:343597383684 2024-09-12T21:56:43.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383684 got 343597383684 for osd.0 2024-09-12T21:56:43.880 DEBUG:teuthology.parallel:result is None 2024-09-12T21:56:43.880 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T21:56:43.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:44.216 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:44.218 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:44.226 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-12T21:56:42.965680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541364,"kb_used_data":4148,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574156,"statfs":{"total":289910292480,"available":289355935744,"internally_reserved":0,"allocated":4247552,"data_stored":2371618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.632553"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645347,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62720,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309120,"statfs":{"total":96636764160,"available":96572538880,"internally_reserved":0,"allocated":1617920,"data_stored":985201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:44.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:44.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:44.564 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:44.573 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-12T21:56:42.965680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541364,"kb_used_data":4148,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574156,"statfs":{"total":289910292480,"available":289355935744,"internally_reserved":0,"allocated":4247552,"data_stored":2371618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.632553"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645347,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62720,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309120,"statfs":{"total":96636764160,"available":96572538880,"internally_reserved":0,"allocated":1617920,"data_stored":985201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:44.580 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T21:56:44.580 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T21:56:44.922 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T21:56:44.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T21:56:44.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:45.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:45.227 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:45.236 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-12T21:56:44.966197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541364,"kb_used_data":4148,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574156,"statfs":{"total":289910292480,"available":289355935744,"internally_reserved":0,"allocated":4247552,"data_stored":2371618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001091"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645347,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62720,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309120,"statfs":{"total":96636764160,"available":96572538880,"internally_reserved":0,"allocated":1617920,"data_stored":985201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:45.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:45.573 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:45.581 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-12T21:56:44.966197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541364,"kb_used_data":4148,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574156,"statfs":{"total":289910292480,"available":289355935744,"internally_reserved":0,"allocated":4247552,"data_stored":2371618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001091"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645347,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62720,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309120,"statfs":{"total":96636764160,"available":96572538880,"internally_reserved":0,"allocated":1617920,"data_stored":985201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:45.588 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T21:56:45.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:45.922 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:45.929 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-12T21:56:44.966197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541364,"kb_used_data":4148,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574156,"statfs":{"total":289910292480,"available":289355935744,"internally_reserved":0,"allocated":4247552,"data_stored":2371618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001091"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645347,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62720,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309120,"statfs":{"total":96636764160,"available":96572538880,"internally_reserved":0,"allocated":1617920,"data_stored":985201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:45.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:56:46.257 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:46.258 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":87,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:56:41.347803+0000","last_up_change":"2024-09-12T21:56:32.306559+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6801","nonce":908289176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6803","nonce":908289176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6807","nonce":908289176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6805","nonce":908289176}]},"public_addr":"172.21.15.89:6801/908289176","cluster_addr":"172.21.15.89:6803/908289176","heartbeat_back_addr":"172.21.15.89:6807/908289176","heartbeat_front_addr":"172.21.15.89:6805/908289176","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":72,"up_thru":80,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6801","nonce":427257840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6803","nonce":427257840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6807","nonce":427257840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6805","nonce":427257840}]},"public_addr":"172.21.15.172:6801/427257840","cluster_addr":"172.21.15.172:6803/427257840","heartbeat_back_addr":"172.21.15.172:6807/427257840","heartbeat_front_addr":"172.21.15.172:6805/427257840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":32}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:56:47.272 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T21:56:47.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T21:56:47.414 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:56:47.414 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T21:56:47.414 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:56:47.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T21:56:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T21:56:47.727 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T21:56:47.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T21:56:47.853 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:56:47.853 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T21:56:47.853 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:56:47.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T21:56:48.154 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T21:56:48.167 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T21:56:48.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T21:56:48.294 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-12T21:56:48.294 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T21:56:48.294 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-12T21:56:48.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T21:56:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T21:56:48.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:56:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:56:48.905 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:56:48.915 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-12T21:56:46.966550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541380,"kb_used_data":4160,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574140,"statfs":{"total":289910292480,"available":289355919360,"internally_reserved":0,"allocated":4259840,"data_stored":2376024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.627771"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352691+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352691+0000","last_peered":"2024-09-12T21:56:41.352691+0000","last_clean":"2024-09-12T21:56:41.352691+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352691+0000","last_undegraded":"2024-09-12T21:56:41.352691+0000","last_fullsized":"2024-09-12T21:56:41.352691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:12.637140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352383+0000","last_change":"2024-09-12T21:53:58.008566+0000","last_active":"2024-09-12T21:56:41.352383+0000","last_peered":"2024-09-12T21:56:41.352383+0000","last_clean":"2024-09-12T21:56:41.352383+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:41.352383+0000","last_undegraded":"2024-09-12T21:56:41.352383+0000","last_fullsized":"2024-09-12T21:56:41.352383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:06.772264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909977+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.909977+0000","last_peered":"2024-09-12T21:56:41.909977+0000","last_clean":"2024-09-12T21:56:41.909977+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.909977+0000","last_undegraded":"2024-09-12T21:56:41.909977+0000","last_fullsized":"2024-09-12T21:56:41.909977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:16.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909344+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909344+0000","last_peered":"2024-09-12T21:56:41.909344+0000","last_clean":"2024-09-12T21:56:41.909344+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909344+0000","last_undegraded":"2024-09-12T21:56:41.909344+0000","last_fullsized":"2024-09-12T21:56:41.909344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:21.016469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351910+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351910+0000","last_peered":"2024-09-12T21:56:41.351910+0000","last_clean":"2024-09-12T21:56:41.351910+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351910+0000","last_undegraded":"2024-09-12T21:56:41.351910+0000","last_fullsized":"2024-09-12T21:56:41.351910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:28.561610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909505+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909505+0000","last_peered":"2024-09-12T21:56:41.909505+0000","last_clean":"2024-09-12T21:56:41.909505+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909505+0000","last_undegraded":"2024-09-12T21:56:41.909505+0000","last_fullsized":"2024-09-12T21:56:41.909505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:15.958202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909153+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909153+0000","last_peered":"2024-09-12T21:56:41.909153+0000","last_clean":"2024-09-12T21:56:41.909153+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909153+0000","last_undegraded":"2024-09-12T21:56:41.909153+0000","last_fullsized":"2024-09-12T21:56:41.909153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.017285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908825+0000","last_change":"2024-09-12T21:56:33.322222+0000","last_active":"2024-09-12T21:56:41.908825+0000","last_peered":"2024-09-12T21:56:41.908825+0000","last_clean":"2024-09-12T21:56:41.908825+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:56:41.908825+0000","last_undegraded":"2024-09-12T21:56:41.908825+0000","last_fullsized":"2024-09-12T21:56:41.908825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:03.754858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352060+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352060+0000","last_peered":"2024-09-12T21:56:41.352060+0000","last_clean":"2024-09-12T21:56:41.352060+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352060+0000","last_undegraded":"2024-09-12T21:56:41.352060+0000","last_fullsized":"2024-09-12T21:56:41.352060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:50.154957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352592+0000","last_change":"2024-09-12T21:53:58.009006+0000","last_active":"2024-09-12T21:56:41.352592+0000","last_peered":"2024-09-12T21:56:41.352592+0000","last_clean":"2024-09-12T21:56:41.352592+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:41.352592+0000","last_undegraded":"2024-09-12T21:56:41.352592+0000","last_fullsized":"2024-09-12T21:56:41.352592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:17.130991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909905+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909905+0000","last_peered":"2024-09-12T21:56:41.909905+0000","last_clean":"2024-09-12T21:56:41.909905+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909905+0000","last_undegraded":"2024-09-12T21:56:41.909905+0000","last_fullsized":"2024-09-12T21:56:41.909905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:03.816317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352263+0000","last_change":"2024-09-12T21:56:33.320250+0000","last_active":"2024-09-12T21:56:41.352263+0000","last_peered":"2024-09-12T21:56:41.352263+0000","last_clean":"2024-09-12T21:56:41.352263+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:41.352263+0000","last_undegraded":"2024-09-12T21:56:41.352263+0000","last_fullsized":"2024-09-12T21:56:41.352263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:05.589883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352245+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352245+0000","last_peered":"2024-09-12T21:56:41.352245+0000","last_clean":"2024-09-12T21:56:41.352245+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352245+0000","last_undegraded":"2024-09-12T21:56:41.352245+0000","last_fullsized":"2024-09-12T21:56:41.352245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:11.122754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909341+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909341+0000","last_peered":"2024-09-12T21:56:41.909341+0000","last_clean":"2024-09-12T21:56:41.909341+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909341+0000","last_undegraded":"2024-09-12T21:56:41.909341+0000","last_fullsized":"2024-09-12T21:56:41.909341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:59.504648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909148+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909148+0000","last_peered":"2024-09-12T21:56:41.909148+0000","last_clean":"2024-09-12T21:56:41.909148+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909148+0000","last_undegraded":"2024-09-12T21:56:41.909148+0000","last_fullsized":"2024-09-12T21:56:41.909148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:17.519808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909096+0000","last_change":"2024-09-12T21:56:33.324212+0000","last_active":"2024-09-12T21:56:41.909096+0000","last_peered":"2024-09-12T21:56:41.909096+0000","last_clean":"2024-09-12T21:56:41.909096+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:41.909096+0000","last_undegraded":"2024-09-12T21:56:41.909096+0000","last_fullsized":"2024-09-12T21:56:41.909096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:31.505324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352309+0000","last_change":"2024-09-12T21:53:58.011405+0000","last_active":"2024-09-12T21:56:41.352309+0000","last_peered":"2024-09-12T21:56:41.352309+0000","last_clean":"2024-09-12T21:56:41.352309+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:41.352309+0000","last_undegraded":"2024-09-12T21:56:41.352309+0000","last_fullsized":"2024-09-12T21:56:41.352309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:46.198828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352320+0000","last_change":"2024-09-12T21:53:58.008409+0000","last_active":"2024-09-12T21:56:41.352320+0000","last_peered":"2024-09-12T21:56:41.352320+0000","last_clean":"2024-09-12T21:56:41.352320+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:56:41.352320+0000","last_undegraded":"2024-09-12T21:56:41.352320+0000","last_fullsized":"2024-09-12T21:56:41.352320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:21.112044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351852+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351852+0000","last_peered":"2024-09-12T21:56:41.351852+0000","last_clean":"2024-09-12T21:56:41.351852+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351852+0000","last_undegraded":"2024-09-12T21:56:41.351852+0000","last_fullsized":"2024-09-12T21:56:41.351852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:23.998840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909458+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909458+0000","last_peered":"2024-09-12T21:56:41.909458+0000","last_clean":"2024-09-12T21:56:41.909458+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909458+0000","last_undegraded":"2024-09-12T21:56:41.909458+0000","last_fullsized":"2024-09-12T21:56:41.909458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:57.124467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909547+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909547+0000","last_peered":"2024-09-12T21:56:41.909547+0000","last_clean":"2024-09-12T21:56:41.909547+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909547+0000","last_undegraded":"2024-09-12T21:56:41.909547+0000","last_fullsized":"2024-09-12T21:56:41.909547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:04.826754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352365+0000","last_change":"2024-09-12T21:56:33.321410+0000","last_active":"2024-09-12T21:56:41.352365+0000","last_peered":"2024-09-12T21:56:41.352365+0000","last_clean":"2024-09-12T21:56:41.352365+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:41.352365+0000","last_undegraded":"2024-09-12T21:56:41.352365+0000","last_fullsized":"2024-09-12T21:56:41.352365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:27.162017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351069+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351069+0000","last_peered":"2024-09-12T21:56:41.351069+0000","last_clean":"2024-09-12T21:56:41.351069+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351069+0000","last_undegraded":"2024-09-12T21:56:41.351069+0000","last_fullsized":"2024-09-12T21:56:41.351069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:21.020601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351769+0000","last_change":"2024-09-12T21:53:58.008423+0000","last_active":"2024-09-12T21:56:41.351769+0000","last_peered":"2024-09-12T21:56:41.351769+0000","last_clean":"2024-09-12T21:56:41.351769+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:56:41.351769+0000","last_undegraded":"2024-09-12T21:56:41.351769+0000","last_fullsized":"2024-09-12T21:56:41.351769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:14.611546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352386+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352386+0000","last_peered":"2024-09-12T21:56:41.352386+0000","last_clean":"2024-09-12T21:56:41.352386+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352386+0000","last_undegraded":"2024-09-12T21:56:41.352386+0000","last_fullsized":"2024-09-12T21:56:41.352386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.698909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351974+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.351974+0000","last_peered":"2024-09-12T21:56:41.351974+0000","last_clean":"2024-09-12T21:56:41.351974+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.351974+0000","last_undegraded":"2024-09-12T21:56:41.351974+0000","last_fullsized":"2024-09-12T21:56:41.351974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:47.671370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909910+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909910+0000","last_peered":"2024-09-12T21:56:41.909910+0000","last_clean":"2024-09-12T21:56:41.909910+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909910+0000","last_undegraded":"2024-09-12T21:56:41.909910+0000","last_fullsized":"2024-09-12T21:56:41.909910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:31.614680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352341+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352341+0000","last_peered":"2024-09-12T21:56:41.352341+0000","last_clean":"2024-09-12T21:56:41.352341+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352341+0000","last_undegraded":"2024-09-12T21:56:41.352341+0000","last_fullsized":"2024-09-12T21:56:41.352341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:01.405786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351640+0000","last_change":"2024-09-12T21:53:58.009751+0000","last_active":"2024-09-12T21:56:41.351640+0000","last_peered":"2024-09-12T21:56:41.351640+0000","last_clean":"2024-09-12T21:56:41.351640+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:56:41.351640+0000","last_undegraded":"2024-09-12T21:56:41.351640+0000","last_fullsized":"2024-09-12T21:56:41.351640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.393713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352419+0000","last_change":"2024-09-12T21:56:33.321002+0000","last_active":"2024-09-12T21:56:41.352419+0000","last_peered":"2024-09-12T21:56:41.352419+0000","last_clean":"2024-09-12T21:56:41.352419+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:41.352419+0000","last_undegraded":"2024-09-12T21:56:41.352419+0000","last_fullsized":"2024-09-12T21:56:41.352419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:10.636259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351132+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:41.351132+0000","last_peered":"2024-09-12T21:56:41.351132+0000","last_clean":"2024-09-12T21:56:41.351132+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:41.351132+0000","last_undegraded":"2024-09-12T21:56:41.351132+0000","last_fullsized":"2024-09-12T21:56:41.351132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:25.925239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909055+0000","last_change":"2024-09-12T21:56:33.323133+0000","last_active":"2024-09-12T21:56:41.909055+0000","last_peered":"2024-09-12T21:56:41.909055+0000","last_clean":"2024-09-12T21:56:41.909055+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:41.909055+0000","last_undegraded":"2024-09-12T21:56:41.909055+0000","last_fullsized":"2024-09-12T21:56:41.909055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:38.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351961+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.351961+0000","last_peered":"2024-09-12T21:56:41.351961+0000","last_clean":"2024-09-12T21:56:41.351961+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.351961+0000","last_undegraded":"2024-09-12T21:56:41.351961+0000","last_fullsized":"2024-09-12T21:56:41.351961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:06.651258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909262+0000","last_change":"2024-09-12T21:56:33.324609+0000","last_active":"2024-09-12T21:56:41.909262+0000","last_peered":"2024-09-12T21:56:41.909262+0000","last_clean":"2024-09-12T21:56:41.909262+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:56:41.909262+0000","last_undegraded":"2024-09-12T21:56:41.909262+0000","last_fullsized":"2024-09-12T21:56:41.909262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:49.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352032+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352032+0000","last_peered":"2024-09-12T21:56:41.352032+0000","last_clean":"2024-09-12T21:56:41.352032+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352032+0000","last_undegraded":"2024-09-12T21:56:41.352032+0000","last_fullsized":"2024-09-12T21:56:41.352032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351581+0000","last_change":"2024-09-12T21:56:33.320530+0000","last_active":"2024-09-12T21:56:41.351581+0000","last_peered":"2024-09-12T21:56:41.351581+0000","last_clean":"2024-09-12T21:56:41.351581+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:56:41.351581+0000","last_undegraded":"2024-09-12T21:56:41.351581+0000","last_fullsized":"2024-09-12T21:56:41.351581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:10.340349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352162+0000","last_change":"2024-09-12T21:56:33.320922+0000","last_active":"2024-09-12T21:56:41.352162+0000","last_peered":"2024-09-12T21:56:41.352162+0000","last_clean":"2024-09-12T21:56:41.352162+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:41.352162+0000","last_undegraded":"2024-09-12T21:56:41.352162+0000","last_fullsized":"2024-09-12T21:56:41.352162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:28.789001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351713+0000","last_change":"2024-09-12T21:56:33.320658+0000","last_active":"2024-09-12T21:56:41.351713+0000","last_peered":"2024-09-12T21:56:41.351713+0000","last_clean":"2024-09-12T21:56:41.351713+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:56:41.351713+0000","last_undegraded":"2024-09-12T21:56:41.351713+0000","last_fullsized":"2024-09-12T21:56:41.351713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:25.109329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352061+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352061+0000","last_peered":"2024-09-12T21:56:41.352061+0000","last_clean":"2024-09-12T21:56:41.352061+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352061+0000","last_undegraded":"2024-09-12T21:56:41.352061+0000","last_fullsized":"2024-09-12T21:56:41.352061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:14.447218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908707+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908707+0000","last_peered":"2024-09-12T21:56:41.908707+0000","last_clean":"2024-09-12T21:56:41.908707+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908707+0000","last_undegraded":"2024-09-12T21:56:41.908707+0000","last_fullsized":"2024-09-12T21:56:41.908707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:57.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909950+0000","last_change":"2024-09-12T21:56:33.324726+0000","last_active":"2024-09-12T21:56:41.909950+0000","last_peered":"2024-09-12T21:56:41.909950+0000","last_clean":"2024-09-12T21:56:41.909950+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:56:41.909950+0000","last_undegraded":"2024-09-12T21:56:41.909950+0000","last_fullsized":"2024-09-12T21:56:41.909950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:13.832012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351689+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351689+0000","last_peered":"2024-09-12T21:56:41.351689+0000","last_clean":"2024-09-12T21:56:41.351689+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351689+0000","last_undegraded":"2024-09-12T21:56:41.351689+0000","last_fullsized":"2024-09-12T21:56:41.351689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352103+0000","last_change":"2024-09-12T21:56:33.320442+0000","last_active":"2024-09-12T21:56:41.352103+0000","last_peered":"2024-09-12T21:56:41.352103+0000","last_clean":"2024-09-12T21:56:41.352103+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:56:41.352103+0000","last_undegraded":"2024-09-12T21:56:41.352103+0000","last_fullsized":"2024-09-12T21:56:41.352103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:30.321302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351528+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351528+0000","last_peered":"2024-09-12T21:56:41.351528+0000","last_clean":"2024-09-12T21:56:41.351528+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351528+0000","last_undegraded":"2024-09-12T21:56:41.351528+0000","last_fullsized":"2024-09-12T21:56:41.351528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:17.304328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909751+0000","last_change":"2024-09-12T21:56:33.325864+0000","last_active":"2024-09-12T21:56:41.909751+0000","last_peered":"2024-09-12T21:56:41.909751+0000","last_clean":"2024-09-12T21:56:41.909751+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:41.909751+0000","last_undegraded":"2024-09-12T21:56:41.909751+0000","last_fullsized":"2024-09-12T21:56:41.909751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909535+0000","last_change":"2024-09-12T21:56:33.326261+0000","last_active":"2024-09-12T21:56:41.909535+0000","last_peered":"2024-09-12T21:56:41.909535+0000","last_clean":"2024-09-12T21:56:41.909535+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:41.909535+0000","last_undegraded":"2024-09-12T21:56:41.909535+0000","last_fullsized":"2024-09-12T21:56:41.909535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.484521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351763+0000","last_change":"2024-09-12T21:53:59.013669+0000","last_active":"2024-09-12T21:56:41.351763+0000","last_peered":"2024-09-12T21:56:41.351763+0000","last_clean":"2024-09-12T21:56:41.351763+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:41.351763+0000","last_undegraded":"2024-09-12T21:56:41.351763+0000","last_fullsized":"2024-09-12T21:56:41.351763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:19.076736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351663+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351663+0000","last_peered":"2024-09-12T21:56:41.351663+0000","last_clean":"2024-09-12T21:56:41.351663+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351663+0000","last_undegraded":"2024-09-12T21:56:41.351663+0000","last_fullsized":"2024-09-12T21:56:41.351663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:50.902735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351815+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351815+0000","last_peered":"2024-09-12T21:56:41.351815+0000","last_clean":"2024-09-12T21:56:41.351815+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351815+0000","last_undegraded":"2024-09-12T21:56:41.351815+0000","last_fullsized":"2024-09-12T21:56:41.351815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:28:02.331539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909577+0000","last_change":"2024-09-12T21:56:33.322364+0000","last_active":"2024-09-12T21:56:41.909577+0000","last_peered":"2024-09-12T21:56:41.909577+0000","last_clean":"2024-09-12T21:56:41.909577+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:41.909577+0000","last_undegraded":"2024-09-12T21:56:41.909577+0000","last_fullsized":"2024-09-12T21:56:41.909577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:05.580511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908950+0000","last_change":"2024-09-12T21:56:33.322396+0000","last_active":"2024-09-12T21:56:41.908950+0000","last_peered":"2024-09-12T21:56:41.908950+0000","last_clean":"2024-09-12T21:56:41.908950+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:41.908950+0000","last_undegraded":"2024-09-12T21:56:41.908950+0000","last_fullsized":"2024-09-12T21:56:41.908950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.141234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909669+0000","last_change":"2024-09-12T21:56:33.326311+0000","last_active":"2024-09-12T21:56:41.909669+0000","last_peered":"2024-09-12T21:56:41.909669+0000","last_clean":"2024-09-12T21:56:41.909669+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:41.909669+0000","last_undegraded":"2024-09-12T21:56:41.909669+0000","last_fullsized":"2024-09-12T21:56:41.909669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:47.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351490+0000","last_change":"2024-09-12T21:56:33.319861+0000","last_active":"2024-09-12T21:56:41.351490+0000","last_peered":"2024-09-12T21:56:41.351490+0000","last_clean":"2024-09-12T21:56:41.351490+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:41.351490+0000","last_undegraded":"2024-09-12T21:56:41.351490+0000","last_fullsized":"2024-09-12T21:56:41.351490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:03.174688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909840+0000","last_change":"2024-09-12T21:56:33.323027+0000","last_active":"2024-09-12T21:56:41.909840+0000","last_peered":"2024-09-12T21:56:41.909840+0000","last_clean":"2024-09-12T21:56:41.909840+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:41.909840+0000","last_undegraded":"2024-09-12T21:56:41.909840+0000","last_fullsized":"2024-09-12T21:56:41.909840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:28.691147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351548+0000","last_change":"2024-09-12T21:53:58.008395+0000","last_active":"2024-09-12T21:56:41.351548+0000","last_peered":"2024-09-12T21:56:41.351548+0000","last_clean":"2024-09-12T21:56:41.351548+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:56:41.351548+0000","last_undegraded":"2024-09-12T21:56:41.351548+0000","last_fullsized":"2024-09-12T21:56:41.351548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:41.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352145+0000","last_change":"2024-09-12T21:53:58.009775+0000","last_active":"2024-09-12T21:56:41.352145+0000","last_peered":"2024-09-12T21:56:41.352145+0000","last_clean":"2024-09-12T21:56:41.352145+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:41.352145+0000","last_undegraded":"2024-09-12T21:56:41.352145+0000","last_fullsized":"2024-09-12T21:56:41.352145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:41.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":362,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908627+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908627+0000","last_peered":"2024-09-12T21:56:41.908627+0000","last_clean":"2024-09-12T21:56:41.908627+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908627+0000","last_undegraded":"2024-09-12T21:56:41.908627+0000","last_fullsized":"2024-09-12T21:56:41.908627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:46.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908997+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.908997+0000","last_peered":"2024-09-12T21:56:41.908997+0000","last_clean":"2024-09-12T21:56:41.908997+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.908997+0000","last_undegraded":"2024-09-12T21:56:41.908997+0000","last_fullsized":"2024-09-12T21:56:41.908997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:51.614062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351394+0000","last_change":"2024-09-12T21:53:58.009650+0000","last_active":"2024-09-12T21:56:41.351394+0000","last_peered":"2024-09-12T21:56:41.351394+0000","last_clean":"2024-09-12T21:56:41.351394+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:56:41.351394+0000","last_undegraded":"2024-09-12T21:56:41.351394+0000","last_fullsized":"2024-09-12T21:56:41.351394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.896261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909812+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909812+0000","last_peered":"2024-09-12T21:56:41.909812+0000","last_clean":"2024-09-12T21:56:41.909812+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909812+0000","last_undegraded":"2024-09-12T21:56:41.909812+0000","last_fullsized":"2024-09-12T21:56:41.909812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:56.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908835+0000","last_change":"2024-09-12T21:56:33.325894+0000","last_active":"2024-09-12T21:56:41.908835+0000","last_peered":"2024-09-12T21:56:41.908835+0000","last_clean":"2024-09-12T21:56:41.908835+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:41.908835+0000","last_undegraded":"2024-09-12T21:56:41.908835+0000","last_fullsized":"2024-09-12T21:56:41.908835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:31.118658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351383+0000","last_change":"2024-09-12T21:53:59.014497+0000","last_active":"2024-09-12T21:56:41.351383+0000","last_peered":"2024-09-12T21:56:41.351383+0000","last_clean":"2024-09-12T21:56:41.351383+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:41.351383+0000","last_undegraded":"2024-09-12T21:56:41.351383+0000","last_fullsized":"2024-09-12T21:56:41.351383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:31.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352528+0000","last_change":"2024-09-12T21:53:58.008973+0000","last_active":"2024-09-12T21:56:41.352528+0000","last_peered":"2024-09-12T21:56:41.352528+0000","last_clean":"2024-09-12T21:56:41.352528+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:41.352528+0000","last_undegraded":"2024-09-12T21:56:41.352528+0000","last_fullsized":"2024-09-12T21:56:41.352528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:01.867769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351549+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:41.351549+0000","last_peered":"2024-09-12T21:56:41.351549+0000","last_clean":"2024-09-12T21:56:41.351549+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:41.351549+0000","last_undegraded":"2024-09-12T21:56:41.351549+0000","last_fullsized":"2024-09-12T21:56:41.351549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:07.277505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":56,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351411+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351411+0000","last_peered":"2024-09-12T21:56:41.351411+0000","last_clean":"2024-09-12T21:56:41.351411+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351411+0000","last_undegraded":"2024-09-12T21:56:41.351411+0000","last_fullsized":"2024-09-12T21:56:41.351411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.568910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352150+0000","last_change":"2024-09-12T21:53:58.010085+0000","last_active":"2024-09-12T21:56:41.352150+0000","last_peered":"2024-09-12T21:56:41.352150+0000","last_clean":"2024-09-12T21:56:41.352150+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:41.352150+0000","last_undegraded":"2024-09-12T21:56:41.352150+0000","last_fullsized":"2024-09-12T21:56:41.352150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:21.236614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908823+0000","last_change":"2024-09-12T21:56:33.321528+0000","last_active":"2024-09-12T21:56:41.908823+0000","last_peered":"2024-09-12T21:56:41.908823+0000","last_clean":"2024-09-12T21:56:41.908823+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:56:41.908823+0000","last_undegraded":"2024-09-12T21:56:41.908823+0000","last_fullsized":"2024-09-12T21:56:41.908823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:27:01.399066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909038+0000","last_change":"2024-09-12T21:56:33.323643+0000","last_active":"2024-09-12T21:56:41.909038+0000","last_peered":"2024-09-12T21:56:41.909038+0000","last_clean":"2024-09-12T21:56:41.909038+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:41.909038+0000","last_undegraded":"2024-09-12T21:56:41.909038+0000","last_fullsized":"2024-09-12T21:56:41.909038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:48.413305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351820+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:41.351820+0000","last_peered":"2024-09-12T21:56:41.351820+0000","last_clean":"2024-09-12T21:56:41.351820+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:41.351820+0000","last_undegraded":"2024-09-12T21:56:41.351820+0000","last_fullsized":"2024-09-12T21:56:41.351820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:24.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909362+0000","last_change":"2024-09-12T21:56:33.324256+0000","last_active":"2024-09-12T21:56:41.909362+0000","last_peered":"2024-09-12T21:56:41.909362+0000","last_clean":"2024-09-12T21:56:41.909362+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:56:41.909362+0000","last_undegraded":"2024-09-12T21:56:41.909362+0000","last_fullsized":"2024-09-12T21:56:41.909362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:47.383384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351970+0000","last_change":"2024-09-12T21:53:58.011265+0000","last_active":"2024-09-12T21:56:41.351970+0000","last_peered":"2024-09-12T21:56:41.351970+0000","last_clean":"2024-09-12T21:56:41.351970+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:41.351970+0000","last_undegraded":"2024-09-12T21:56:41.351970+0000","last_fullsized":"2024-09-12T21:56:41.351970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352191+0000","last_change":"2024-09-12T21:56:33.321268+0000","last_active":"2024-09-12T21:56:41.352191+0000","last_peered":"2024-09-12T21:56:41.352191+0000","last_clean":"2024-09-12T21:56:41.352191+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:41.352191+0000","last_undegraded":"2024-09-12T21:56:41.352191+0000","last_fullsized":"2024-09-12T21:56:41.352191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:21.550279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351969+0000","last_change":"2024-09-12T21:53:58.011016+0000","last_active":"2024-09-12T21:56:41.351969+0000","last_peered":"2024-09-12T21:56:41.351969+0000","last_clean":"2024-09-12T21:56:41.351969+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:41.351969+0000","last_undegraded":"2024-09-12T21:56:41.351969+0000","last_fullsized":"2024-09-12T21:56:41.351969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:04.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352679+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352679+0000","last_peered":"2024-09-12T21:56:41.352679+0000","last_clean":"2024-09-12T21:56:41.352679+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352679+0000","last_undegraded":"2024-09-12T21:56:41.352679+0000","last_fullsized":"2024-09-12T21:56:41.352679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:49.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351699+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351699+0000","last_peered":"2024-09-12T21:56:41.351699+0000","last_clean":"2024-09-12T21:56:41.351699+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351699+0000","last_undegraded":"2024-09-12T21:56:41.351699+0000","last_fullsized":"2024-09-12T21:56:41.351699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:51.774658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352351+0000","last_change":"2024-09-12T21:53:58.011603+0000","last_active":"2024-09-12T21:56:41.352351+0000","last_peered":"2024-09-12T21:56:41.352351+0000","last_clean":"2024-09-12T21:56:41.352351+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:41.352351+0000","last_undegraded":"2024-09-12T21:56:41.352351+0000","last_fullsized":"2024-09-12T21:56:41.352351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:16.888288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352282+0000","last_change":"2024-09-12T21:53:58.012179+0000","last_active":"2024-09-12T21:56:41.352282+0000","last_peered":"2024-09-12T21:56:41.352282+0000","last_clean":"2024-09-12T21:56:41.352282+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:41.352282+0000","last_undegraded":"2024-09-12T21:56:41.352282+0000","last_fullsized":"2024-09-12T21:56:41.352282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:28.587405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351205+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351205+0000","last_peered":"2024-09-12T21:56:41.351205+0000","last_clean":"2024-09-12T21:56:41.351205+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351205+0000","last_undegraded":"2024-09-12T21:56:41.351205+0000","last_fullsized":"2024-09-12T21:56:41.351205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:37.203233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352231+0000","last_change":"2024-09-12T21:53:59.016410+0000","last_active":"2024-09-12T21:56:41.352231+0000","last_peered":"2024-09-12T21:56:41.352231+0000","last_clean":"2024-09-12T21:56:41.352231+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:41.352231+0000","last_undegraded":"2024-09-12T21:56:41.352231+0000","last_fullsized":"2024-09-12T21:56:41.352231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:20.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909770+0000","last_change":"2024-09-12T21:56:33.321452+0000","last_active":"2024-09-12T21:56:41.909770+0000","last_peered":"2024-09-12T21:56:41.909770+0000","last_clean":"2024-09-12T21:56:41.909770+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:56:41.909770+0000","last_undegraded":"2024-09-12T21:56:41.909770+0000","last_fullsized":"2024-09-12T21:56:41.909770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:35.553176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351866+0000","last_change":"2024-09-12T21:56:33.322062+0000","last_active":"2024-09-12T21:56:41.351866+0000","last_peered":"2024-09-12T21:56:41.351866+0000","last_clean":"2024-09-12T21:56:41.351866+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:41.351866+0000","last_undegraded":"2024-09-12T21:56:41.351866+0000","last_fullsized":"2024-09-12T21:56:41.351866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:48.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.326471+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:18.051617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909178+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909178+0000","last_peered":"2024-09-12T21:56:41.909178+0000","last_clean":"2024-09-12T21:56:41.909178+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909178+0000","last_undegraded":"2024-09-12T21:56:41.909178+0000","last_fullsized":"2024-09-12T21:56:41.909178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:30.920575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351236+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351236+0000","last_peered":"2024-09-12T21:56:41.351236+0000","last_clean":"2024-09-12T21:56:41.351236+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351236+0000","last_undegraded":"2024-09-12T21:56:41.351236+0000","last_fullsized":"2024-09-12T21:56:41.351236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:32.654433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352379+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352379+0000","last_peered":"2024-09-12T21:56:41.352379+0000","last_clean":"2024-09-12T21:56:41.352379+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352379+0000","last_undegraded":"2024-09-12T21:56:41.352379+0000","last_fullsized":"2024-09-12T21:56:41.352379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:20.285771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909725+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909725+0000","last_peered":"2024-09-12T21:56:41.909725+0000","last_clean":"2024-09-12T21:56:41.909725+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909725+0000","last_undegraded":"2024-09-12T21:56:41.909725+0000","last_fullsized":"2024-09-12T21:56:41.909725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:32.505216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351190+0000","last_change":"2024-09-12T21:56:33.320846+0000","last_active":"2024-09-12T21:56:41.351190+0000","last_peered":"2024-09-12T21:56:41.351190+0000","last_clean":"2024-09-12T21:56:41.351190+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:41.351190+0000","last_undegraded":"2024-09-12T21:56:41.351190+0000","last_fullsized":"2024-09-12T21:56:41.351190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:38.234241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352279+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352279+0000","last_peered":"2024-09-12T21:56:41.352279+0000","last_clean":"2024-09-12T21:56:41.352279+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352279+0000","last_undegraded":"2024-09-12T21:56:41.352279+0000","last_fullsized":"2024-09-12T21:56:41.352279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:53.044137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351201+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351201+0000","last_peered":"2024-09-12T21:56:41.351201+0000","last_clean":"2024-09-12T21:56:41.351201+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351201+0000","last_undegraded":"2024-09-12T21:56:41.351201+0000","last_fullsized":"2024-09-12T21:56:41.351201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:52.595686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352462+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352462+0000","last_peered":"2024-09-12T21:56:41.352462+0000","last_clean":"2024-09-12T21:56:41.352462+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352462+0000","last_undegraded":"2024-09-12T21:56:41.352462+0000","last_fullsized":"2024-09-12T21:56:41.352462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:26.072809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351334+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351334+0000","last_peered":"2024-09-12T21:56:41.351334+0000","last_clean":"2024-09-12T21:56:41.351334+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351334+0000","last_undegraded":"2024-09-12T21:56:41.351334+0000","last_fullsized":"2024-09-12T21:56:41.351334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.198625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352041+0000","last_change":"2024-09-12T21:56:33.321330+0000","last_active":"2024-09-12T21:56:41.352041+0000","last_peered":"2024-09-12T21:56:41.352041+0000","last_clean":"2024-09-12T21:56:41.352041+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:56:41.352041+0000","last_undegraded":"2024-09-12T21:56:41.352041+0000","last_fullsized":"2024-09-12T21:56:41.352041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:45.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351399+0000","last_change":"2024-09-12T21:56:33.320837+0000","last_active":"2024-09-12T21:56:41.351399+0000","last_peered":"2024-09-12T21:56:41.351399+0000","last_clean":"2024-09-12T21:56:41.351399+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:56:41.351399+0000","last_undegraded":"2024-09-12T21:56:41.351399+0000","last_fullsized":"2024-09-12T21:56:41.351399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:00.986780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352274+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352274+0000","last_peered":"2024-09-12T21:56:41.352274+0000","last_clean":"2024-09-12T21:56:41.352274+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352274+0000","last_undegraded":"2024-09-12T21:56:41.352274+0000","last_fullsized":"2024-09-12T21:56:41.352274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:03.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351937+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.351937+0000","last_peered":"2024-09-12T21:56:41.351937+0000","last_clean":"2024-09-12T21:56:41.351937+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.351937+0000","last_undegraded":"2024-09-12T21:56:41.351937+0000","last_fullsized":"2024-09-12T21:56:41.351937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:23.494462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352025+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352025+0000","last_peered":"2024-09-12T21:56:41.352025+0000","last_clean":"2024-09-12T21:56:41.352025+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352025+0000","last_undegraded":"2024-09-12T21:56:41.352025+0000","last_fullsized":"2024-09-12T21:56:41.352025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.205368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351963+0000","last_change":"2024-09-12T21:53:59.014152+0000","last_active":"2024-09-12T21:56:41.351963+0000","last_peered":"2024-09-12T21:56:41.351963+0000","last_clean":"2024-09-12T21:56:41.351963+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:41.351963+0000","last_undegraded":"2024-09-12T21:56:41.351963+0000","last_fullsized":"2024-09-12T21:56:41.351963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.716635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909311+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909311+0000","last_peered":"2024-09-12T21:56:41.909311+0000","last_clean":"2024-09-12T21:56:41.909311+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909311+0000","last_undegraded":"2024-09-12T21:56:41.909311+0000","last_fullsized":"2024-09-12T21:56:41.909311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":119,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909145+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909145+0000","last_peered":"2024-09-12T21:56:41.909145+0000","last_clean":"2024-09-12T21:56:41.909145+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909145+0000","last_undegraded":"2024-09-12T21:56:41.909145+0000","last_fullsized":"2024-09-12T21:56:41.909145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:12.701756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909122+0000","last_change":"2024-09-12T21:56:33.322980+0000","last_active":"2024-09-12T21:56:41.909122+0000","last_peered":"2024-09-12T21:56:41.909122+0000","last_clean":"2024-09-12T21:56:41.909122+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:41.909122+0000","last_undegraded":"2024-09-12T21:56:41.909122+0000","last_fullsized":"2024-09-12T21:56:41.909122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:52.391093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351936+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.351936+0000","last_peered":"2024-09-12T21:56:41.351936+0000","last_clean":"2024-09-12T21:56:41.351936+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.351936+0000","last_undegraded":"2024-09-12T21:56:41.351936+0000","last_fullsized":"2024-09-12T21:56:41.351936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:05.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351682+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351682+0000","last_peered":"2024-09-12T21:56:41.351682+0000","last_clean":"2024-09-12T21:56:41.351682+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351682+0000","last_undegraded":"2024-09-12T21:56:41.351682+0000","last_fullsized":"2024-09-12T21:56:41.351682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:58.230379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352166+0000","last_change":"2024-09-12T21:53:58.012001+0000","last_active":"2024-09-12T21:56:41.352166+0000","last_peered":"2024-09-12T21:56:41.352166+0000","last_clean":"2024-09-12T21:56:41.352166+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:41.352166+0000","last_undegraded":"2024-09-12T21:56:41.352166+0000","last_fullsized":"2024-09-12T21:56:41.352166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:58.389146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908952+0000","last_change":"2024-09-12T21:56:33.322591+0000","last_active":"2024-09-12T21:56:41.908952+0000","last_peered":"2024-09-12T21:56:41.908952+0000","last_clean":"2024-09-12T21:56:41.908952+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:41.908952+0000","last_undegraded":"2024-09-12T21:56:41.908952+0000","last_fullsized":"2024-09-12T21:56:41.908952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:28.636641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352227+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:41.352227+0000","last_peered":"2024-09-12T21:56:41.352227+0000","last_clean":"2024-09-12T21:56:41.352227+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:41.352227+0000","last_undegraded":"2024-09-12T21:56:41.352227+0000","last_fullsized":"2024-09-12T21:56:41.352227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:09.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645348,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41088,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330752,"statfs":{"total":96636764160,"available":96594690048,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437556,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934284,"statfs":{"total":96636764160,"available":96188706816,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383685,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62736,"kb_used_data":1592,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309104,"statfs":{"total":96636764160,"available":96572522496,"internally_reserved":0,"allocated":1630208,"data_stored":989607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.924 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.925 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.926 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.927 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.928 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.929 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.930 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T21:50:29.696180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.931 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.932 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.933 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.934 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.935 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.936 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.936 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.936 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.936 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.937 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.938 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.938 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.938 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:56:48.938 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T21:57:08.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:57:09.255 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:57:09.256 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:57:09.265 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-12T21:57:08.972588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541360,"kb_used_data":4160,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574160,"statfs":{"total":289910292480,"available":289355939840,"internally_reserved":0,"allocated":4259840,"data_stored":2376024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003475"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352736+0000","last_change":"2024-09-12T21:53:58.007542+0000","last_active":"2024-09-12T21:56:41.352736+0000","last_peered":"2024-09-12T21:56:41.352736+0000","last_clean":"2024-09-12T21:56:41.352736+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:56:41.352736+0000","last_undegraded":"2024-09-12T21:56:41.352736+0000","last_fullsized":"2024-09-12T21:56:41.352736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.099711+0000","last_change":"2024-09-12T21:56:58.099736+0000","last_active":"2024-09-12T21:56:58.099711+0000","last_peered":"2024-09-12T21:56:58.099711+0000","last_clean":"2024-09-12T21:56:58.099711+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:58.099711+0000","last_undegraded":"2024-09-12T21:56:58.099711+0000","last_fullsized":"2024-09-12T21:56:58.099711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.099579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.099579+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.099579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:06.450290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.910013+0000","last_change":"2024-09-12T21:56:33.328394+0000","last_active":"2024-09-12T21:56:41.910013+0000","last_peered":"2024-09-12T21:56:41.910013+0000","last_clean":"2024-09-12T21:56:41.910013+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:56:41.910013+0000","last_undegraded":"2024-09-12T21:56:41.910013+0000","last_fullsized":"2024-09-12T21:56:41.910013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909423+0000","last_change":"2024-09-12T21:56:33.321165+0000","last_active":"2024-09-12T21:56:41.909423+0000","last_peered":"2024-09-12T21:56:41.909423+0000","last_clean":"2024-09-12T21:56:41.909423+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:56:41.909423+0000","last_undegraded":"2024-09-12T21:56:41.909423+0000","last_fullsized":"2024-09-12T21:56:41.909423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351964+0000","last_change":"2024-09-12T21:53:58.007424+0000","last_active":"2024-09-12T21:56:41.351964+0000","last_peered":"2024-09-12T21:56:41.351964+0000","last_clean":"2024-09-12T21:56:41.351964+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:56:41.351964+0000","last_undegraded":"2024-09-12T21:56:41.351964+0000","last_fullsized":"2024-09-12T21:56:41.351964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909566+0000","last_change":"2024-09-12T21:56:33.324901+0000","last_active":"2024-09-12T21:56:41.909566+0000","last_peered":"2024-09-12T21:56:41.909566+0000","last_clean":"2024-09-12T21:56:41.909566+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:56:41.909566+0000","last_undegraded":"2024-09-12T21:56:41.909566+0000","last_fullsized":"2024-09-12T21:56:41.909566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909243+0000","last_change":"2024-09-12T21:56:33.320729+0000","last_active":"2024-09-12T21:56:41.909243+0000","last_peered":"2024-09-12T21:56:41.909243+0000","last_clean":"2024-09-12T21:56:41.909243+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:56:41.909243+0000","last_undegraded":"2024-09-12T21:56:41.909243+0000","last_fullsized":"2024-09-12T21:56:41.909243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.853449+0000","last_change":"2024-09-12T21:57:01.853473+0000","last_active":"2024-09-12T21:57:01.853449+0000","last_peered":"2024-09-12T21:57:01.853449+0000","last_clean":"2024-09-12T21:57:01.853449+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:57:01.853449+0000","last_undegraded":"2024-09-12T21:57:01.853449+0000","last_fullsized":"2024-09-12T21:57:01.853449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:01.853327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:01.853327+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.853327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:02.342210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352110+0000","last_change":"2024-09-12T21:53:58.009461+0000","last_active":"2024-09-12T21:56:41.352110+0000","last_peered":"2024-09-12T21:56:41.352110+0000","last_clean":"2024-09-12T21:56:41.352110+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:56:41.352110+0000","last_undegraded":"2024-09-12T21:56:41.352110+0000","last_fullsized":"2024-09-12T21:56:41.352110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.075650+0000","last_change":"2024-09-12T21:56:54.075696+0000","last_active":"2024-09-12T21:56:54.075650+0000","last_peered":"2024-09-12T21:56:54.075650+0000","last_clean":"2024-09-12T21:56:54.075650+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:54.075650+0000","last_undegraded":"2024-09-12T21:56:54.075650+0000","last_fullsized":"2024-09-12T21:56:54.075650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:54.075547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:54.075547+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.075547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.914685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909932+0000","last_change":"2024-09-12T21:56:33.326728+0000","last_active":"2024-09-12T21:56:41.909932+0000","last_peered":"2024-09-12T21:56:41.909932+0000","last_clean":"2024-09-12T21:56:41.909932+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:56:41.909932+0000","last_undegraded":"2024-09-12T21:56:41.909932+0000","last_fullsized":"2024-09-12T21:56:41.909932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.145945+0000","last_change":"2024-09-12T21:56:59.145969+0000","last_active":"2024-09-12T21:56:59.145945+0000","last_peered":"2024-09-12T21:56:59.145945+0000","last_clean":"2024-09-12T21:56:59.145945+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:59.145945+0000","last_undegraded":"2024-09-12T21:56:59.145945+0000","last_fullsized":"2024-09-12T21:56:59.145945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.145857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.145857+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.145857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:58.244227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352359+0000","last_change":"2024-09-12T21:53:58.007522+0000","last_active":"2024-09-12T21:56:41.352359+0000","last_peered":"2024-09-12T21:56:41.352359+0000","last_clean":"2024-09-12T21:56:41.352359+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:56:41.352359+0000","last_undegraded":"2024-09-12T21:56:41.352359+0000","last_fullsized":"2024-09-12T21:56:41.352359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909406+0000","last_change":"2024-09-12T21:56:33.328106+0000","last_active":"2024-09-12T21:56:41.909406+0000","last_peered":"2024-09-12T21:56:41.909406+0000","last_clean":"2024-09-12T21:56:41.909406+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:56:41.909406+0000","last_undegraded":"2024-09-12T21:56:41.909406+0000","last_fullsized":"2024-09-12T21:56:41.909406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909204+0000","last_change":"2024-09-12T21:56:33.319189+0000","last_active":"2024-09-12T21:56:41.909204+0000","last_peered":"2024-09-12T21:56:41.909204+0000","last_clean":"2024-09-12T21:56:41.909204+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:56:41.909204+0000","last_undegraded":"2024-09-12T21:56:41.909204+0000","last_fullsized":"2024-09-12T21:56:41.909204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.779558+0000","last_change":"2024-09-12T21:56:58.779580+0000","last_active":"2024-09-12T21:56:58.779558+0000","last_peered":"2024-09-12T21:56:58.779558+0000","last_clean":"2024-09-12T21:56:58.779558+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:58.779558+0000","last_undegraded":"2024-09-12T21:56:58.779558+0000","last_fullsized":"2024-09-12T21:56:58.779558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.779439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.779439+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.779439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:31.829649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.729295+0000","last_change":"2024-09-12T21:56:51.729330+0000","last_active":"2024-09-12T21:56:51.729295+0000","last_peered":"2024-09-12T21:56:51.729295+0000","last_clean":"2024-09-12T21:56:51.729295+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:51.729295+0000","last_undegraded":"2024-09-12T21:56:51.729295+0000","last_fullsized":"2024-09-12T21:56:51.729295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:51.729158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:51.729158+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.729158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:16.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.172354+0000","last_change":"2024-09-12T21:57:02.172385+0000","last_active":"2024-09-12T21:57:02.172354+0000","last_peered":"2024-09-12T21:57:02.172354+0000","last_clean":"2024-09-12T21:57:02.172354+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:57:02.172354+0000","last_undegraded":"2024-09-12T21:57:02.172354+0000","last_fullsized":"2024-09-12T21:57:02.172354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:02.172258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:02.172258+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.172258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:36.354040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351931+0000","last_change":"2024-09-12T21:53:58.009540+0000","last_active":"2024-09-12T21:56:41.351931+0000","last_peered":"2024-09-12T21:56:41.351931+0000","last_clean":"2024-09-12T21:56:41.351931+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:56:41.351931+0000","last_undegraded":"2024-09-12T21:56:41.351931+0000","last_fullsized":"2024-09-12T21:56:41.351931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909520+0000","last_change":"2024-09-12T21:56:33.321302+0000","last_active":"2024-09-12T21:56:41.909520+0000","last_peered":"2024-09-12T21:56:41.909520+0000","last_clean":"2024-09-12T21:56:41.909520+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:56:41.909520+0000","last_undegraded":"2024-09-12T21:56:41.909520+0000","last_fullsized":"2024-09-12T21:56:41.909520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909610+0000","last_change":"2024-09-12T21:56:33.327626+0000","last_active":"2024-09-12T21:56:41.909610+0000","last_peered":"2024-09-12T21:56:41.909610+0000","last_clean":"2024-09-12T21:56:41.909610+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:56:41.909610+0000","last_undegraded":"2024-09-12T21:56:41.909610+0000","last_fullsized":"2024-09-12T21:56:41.909610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.047262+0000","last_change":"2024-09-12T21:56:49.047296+0000","last_active":"2024-09-12T21:56:49.047262+0000","last_peered":"2024-09-12T21:56:49.047262+0000","last_clean":"2024-09-12T21:56:49.047262+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:49.047262+0000","last_undegraded":"2024-09-12T21:56:49.047262+0000","last_fullsized":"2024-09-12T21:56:49.047262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:49.047176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:49.047176+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.047176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:58.697520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351121+0000","last_change":"2024-09-12T21:56:33.321867+0000","last_active":"2024-09-12T21:56:41.351121+0000","last_peered":"2024-09-12T21:56:41.351121+0000","last_clean":"2024-09-12T21:56:41.351121+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:56:41.351121+0000","last_undegraded":"2024-09-12T21:56:41.351121+0000","last_fullsized":"2024-09-12T21:56:41.351121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.179644+0000","last_change":"2024-09-12T21:57:00.179670+0000","last_active":"2024-09-12T21:57:00.179644+0000","last_peered":"2024-09-12T21:57:00.179644+0000","last_clean":"2024-09-12T21:57:00.179644+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:57:00.179644+0000","last_undegraded":"2024-09-12T21:57:00.179644+0000","last_fullsized":"2024-09-12T21:57:00.179644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.179558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.179558+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.179558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352439+0000","last_change":"2024-09-12T21:56:33.322125+0000","last_active":"2024-09-12T21:56:41.352439+0000","last_peered":"2024-09-12T21:56:41.352439+0000","last_clean":"2024-09-12T21:56:41.352439+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:56:41.352439+0000","last_undegraded":"2024-09-12T21:56:41.352439+0000","last_fullsized":"2024-09-12T21:56:41.352439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352027+0000","last_change":"2024-09-12T21:56:33.321873+0000","last_active":"2024-09-12T21:56:41.352027+0000","last_peered":"2024-09-12T21:56:41.352027+0000","last_clean":"2024-09-12T21:56:41.352027+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:56:41.352027+0000","last_undegraded":"2024-09-12T21:56:41.352027+0000","last_fullsized":"2024-09-12T21:56:41.352027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909960+0000","last_change":"2024-09-12T21:56:33.328181+0000","last_active":"2024-09-12T21:56:41.909960+0000","last_peered":"2024-09-12T21:56:41.909960+0000","last_clean":"2024-09-12T21:56:41.909960+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:56:41.909960+0000","last_undegraded":"2024-09-12T21:56:41.909960+0000","last_fullsized":"2024-09-12T21:56:41.909960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352402+0000","last_change":"2024-09-12T21:56:33.320722+0000","last_active":"2024-09-12T21:56:41.352402+0000","last_peered":"2024-09-12T21:56:41.352402+0000","last_clean":"2024-09-12T21:56:41.352402+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:56:41.352402+0000","last_undegraded":"2024-09-12T21:56:41.352402+0000","last_fullsized":"2024-09-12T21:56:41.352402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.606282+0000","last_change":"2024-09-12T21:57:03.606307+0000","last_active":"2024-09-12T21:57:03.606282+0000","last_peered":"2024-09-12T21:57:03.606282+0000","last_clean":"2024-09-12T21:57:03.606282+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:57:03.606282+0000","last_undegraded":"2024-09-12T21:57:03.606282+0000","last_fullsized":"2024-09-12T21:57:03.606282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:03.606151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:03.606151+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.606151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:45.891987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.063597+0000","last_change":"2024-09-12T21:56:52.063661+0000","last_active":"2024-09-12T21:56:52.063597+0000","last_peered":"2024-09-12T21:56:52.063597+0000","last_clean":"2024-09-12T21:56:52.063597+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:52.063597+0000","last_undegraded":"2024-09-12T21:56:52.063597+0000","last_fullsized":"2024-09-12T21:56:52.063597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.063500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.063500+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.063500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:30.621510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.154499+0000","last_change":"2024-09-12T21:53:58.006010+0000","last_active":"2024-09-12T21:56:48.154499+0000","last_peered":"2024-09-12T21:56:48.154499+0000","last_clean":"2024-09-12T21:56:48.154499+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:56:48.154499+0000","last_undegraded":"2024-09-12T21:56:48.154499+0000","last_fullsized":"2024-09-12T21:56:48.154499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.741135+0000","last_change":"2024-09-12T21:56:52.741159+0000","last_active":"2024-09-12T21:56:52.741135+0000","last_peered":"2024-09-12T21:56:52.741135+0000","last_clean":"2024-09-12T21:56:52.741135+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:52.741135+0000","last_undegraded":"2024-09-12T21:56:52.741135+0000","last_fullsized":"2024-09-12T21:56:52.741135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.741046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.741046+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.741046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:25.193230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352141+0000","last_change":"2024-09-12T21:53:58.007326+0000","last_active":"2024-09-12T21:56:41.352141+0000","last_peered":"2024-09-12T21:56:41.352141+0000","last_clean":"2024-09-12T21:56:41.352141+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:56:41.352141+0000","last_undegraded":"2024-09-12T21:56:41.352141+0000","last_fullsized":"2024-09-12T21:56:41.352141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"87'4","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.905527+0000","last_change":"2024-09-12T21:57:02.905558+0000","last_active":"2024-09-12T21:57:02.905527+0000","last_peered":"2024-09-12T21:57:02.905527+0000","last_clean":"2024-09-12T21:57:02.905527+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:57:02.905527+0000","last_undegraded":"2024-09-12T21:57:02.905527+0000","last_fullsized":"2024-09-12T21:57:02.905527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'4","last_scrub_stamp":"2024-09-12T21:57:02.905431+0000","last_deep_scrub":"87'4","last_deep_scrub_stamp":"2024-09-12T21:57:02.905431+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.905431+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:43.771747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352293+0000","last_change":"2024-09-12T21:53:58.007059+0000","last_active":"2024-09-12T21:56:41.352293+0000","last_peered":"2024-09-12T21:56:41.352293+0000","last_clean":"2024-09-12T21:56:41.352293+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:56:41.352293+0000","last_undegraded":"2024-09-12T21:56:41.352293+0000","last_fullsized":"2024-09-12T21:56:41.352293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.222133+0000","last_change":"2024-09-12T21:57:03.222156+0000","last_active":"2024-09-12T21:57:03.222133+0000","last_peered":"2024-09-12T21:57:03.222133+0000","last_clean":"2024-09-12T21:57:03.222133+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:57:03.222133+0000","last_undegraded":"2024-09-12T21:57:03.222133+0000","last_fullsized":"2024-09-12T21:57:03.222133+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:03.222022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:03.222022+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.222022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:05.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.567115+0000","last_change":"2024-09-12T21:56:58.567142+0000","last_active":"2024-09-12T21:56:58.567115+0000","last_peered":"2024-09-12T21:56:58.567115+0000","last_clean":"2024-09-12T21:56:58.567115+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:58.567115+0000","last_undegraded":"2024-09-12T21:56:58.567115+0000","last_fullsized":"2024-09-12T21:56:58.567115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.567027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.567027+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.567027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:37.899762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:05.164214+0000","last_change":"2024-09-12T21:57:05.164239+0000","last_active":"2024-09-12T21:57:05.164214+0000","last_peered":"2024-09-12T21:57:05.164214+0000","last_clean":"2024-09-12T21:57:05.164214+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:57:05.164214+0000","last_undegraded":"2024-09-12T21:57:05.164214+0000","last_fullsized":"2024-09-12T21:57:05.164214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:05.164127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:05.164127+0000","last_clean_scrub_stamp":"2024-09-12T21:57:05.164127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:45.701409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352091+0000","last_change":"2024-09-12T21:56:33.322436+0000","last_active":"2024-09-12T21:56:41.352091+0000","last_peered":"2024-09-12T21:56:41.352091+0000","last_clean":"2024-09-12T21:56:41.352091+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:56:41.352091+0000","last_undegraded":"2024-09-12T21:56:41.352091+0000","last_fullsized":"2024-09-12T21:56:41.352091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908750+0000","last_change":"2024-09-12T21:56:33.320126+0000","last_active":"2024-09-12T21:56:41.908750+0000","last_peered":"2024-09-12T21:56:41.908750+0000","last_clean":"2024-09-12T21:56:41.908750+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:56:41.908750+0000","last_undegraded":"2024-09-12T21:56:41.908750+0000","last_fullsized":"2024-09-12T21:56:41.908750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'2","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:04.891084+0000","last_change":"2024-09-12T21:57:04.891112+0000","last_active":"2024-09-12T21:57:04.891084+0000","last_peered":"2024-09-12T21:57:04.891084+0000","last_clean":"2024-09-12T21:57:04.891084+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:57:04.891084+0000","last_undegraded":"2024-09-12T21:57:04.891084+0000","last_fullsized":"2024-09-12T21:57:04.891084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:57:04.891001+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:57:04.891001+0000","last_clean_scrub_stamp":"2024-09-12T21:57:04.891001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:07.208337+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351816+0000","last_change":"2024-09-12T21:56:33.328533+0000","last_active":"2024-09-12T21:56:41.351816+0000","last_peered":"2024-09-12T21:56:41.351816+0000","last_clean":"2024-09-12T21:56:41.351816+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:56:41.351816+0000","last_undegraded":"2024-09-12T21:56:41.351816+0000","last_fullsized":"2024-09-12T21:56:41.351816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"87'3","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.143977+0000","last_change":"2024-09-12T21:57:01.144033+0000","last_active":"2024-09-12T21:57:01.143977+0000","last_peered":"2024-09-12T21:57:01.143977+0000","last_clean":"2024-09-12T21:57:01.143977+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:57:01.143977+0000","last_undegraded":"2024-09-12T21:57:01.143977+0000","last_fullsized":"2024-09-12T21:57:01.143977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:01.143864+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:01.143864+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.143864+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:02.873101+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351589+0000","last_change":"2024-09-12T21:53:58.007038+0000","last_active":"2024-09-12T21:56:41.351589+0000","last_peered":"2024-09-12T21:56:41.351589+0000","last_clean":"2024-09-12T21:56:41.351589+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:56:41.351589+0000","last_undegraded":"2024-09-12T21:56:41.351589+0000","last_fullsized":"2024-09-12T21:56:41.351589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'2","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.703298+0000","last_change":"2024-09-12T21:56:51.703329+0000","last_active":"2024-09-12T21:56:51.703298+0000","last_peered":"2024-09-12T21:56:51.703298+0000","last_clean":"2024-09-12T21:56:51.703298+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:51.703298+0000","last_undegraded":"2024-09-12T21:56:51.703298+0000","last_fullsized":"2024-09-12T21:56:51.703298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:56:51.703205+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:56:51.703205+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.703205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:02.457889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.830375+0000","last_change":"2024-09-12T21:56:48.830400+0000","last_active":"2024-09-12T21:56:48.830375+0000","last_peered":"2024-09-12T21:56:48.830375+0000","last_clean":"2024-09-12T21:56:48.830375+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:48.830375+0000","last_undegraded":"2024-09-12T21:56:48.830375+0000","last_fullsized":"2024-09-12T21:56:48.830375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:48.830236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:48.830236+0000","last_clean_scrub_stamp":"2024-09-12T21:56:48.830236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:25.577528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.083411+0000","last_change":"2024-09-12T21:56:53.083466+0000","last_active":"2024-09-12T21:56:53.083411+0000","last_peered":"2024-09-12T21:56:53.083411+0000","last_clean":"2024-09-12T21:56:53.083411+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:53.083411+0000","last_undegraded":"2024-09-12T21:56:53.083411+0000","last_fullsized":"2024-09-12T21:56:53.083411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.083315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.083315+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.083315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:17.932387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351723+0000","last_change":"2024-09-12T21:56:33.327435+0000","last_active":"2024-09-12T21:56:41.351723+0000","last_peered":"2024-09-12T21:56:41.351723+0000","last_clean":"2024-09-12T21:56:41.351723+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:56:41.351723+0000","last_undegraded":"2024-09-12T21:56:41.351723+0000","last_fullsized":"2024-09-12T21:56:41.351723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":162,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351898+0000","last_change":"2024-09-12T21:56:33.327802+0000","last_active":"2024-09-12T21:56:41.351898+0000","last_peered":"2024-09-12T21:56:41.351898+0000","last_clean":"2024-09-12T21:56:41.351898+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:56:41.351898+0000","last_undegraded":"2024-09-12T21:56:41.351898+0000","last_fullsized":"2024-09-12T21:56:41.351898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.806652+0000","last_change":"2024-09-12T21:56:59.806675+0000","last_active":"2024-09-12T21:56:59.806652+0000","last_peered":"2024-09-12T21:56:59.806652+0000","last_clean":"2024-09-12T21:56:59.806652+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:59.806652+0000","last_undegraded":"2024-09-12T21:56:59.806652+0000","last_fullsized":"2024-09-12T21:56:59.806652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.806556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.806556+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.806556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:21.521164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.744527+0000","last_change":"2024-09-12T21:56:57.744570+0000","last_active":"2024-09-12T21:56:57.744527+0000","last_peered":"2024-09-12T21:56:57.744527+0000","last_clean":"2024-09-12T21:56:57.744527+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:57.744527+0000","last_undegraded":"2024-09-12T21:56:57.744527+0000","last_fullsized":"2024-09-12T21:56:57.744527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.744429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.744429+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.744429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:47.538942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:47.809582+0000","last_change":"2024-09-12T21:56:47.809603+0000","last_active":"2024-09-12T21:56:47.809582+0000","last_peered":"2024-09-12T21:56:47.809582+0000","last_clean":"2024-09-12T21:56:47.809582+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:47.809582+0000","last_undegraded":"2024-09-12T21:56:47.809582+0000","last_fullsized":"2024-09-12T21:56:47.809582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:47.809497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:47.809497+0000","last_clean_scrub_stamp":"2024-09-12T21:56:47.809497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:24.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.105099+0000","last_change":"2024-09-12T21:56:57.105124+0000","last_active":"2024-09-12T21:56:57.105099+0000","last_peered":"2024-09-12T21:56:57.105099+0000","last_clean":"2024-09-12T21:56:57.105099+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:57.105099+0000","last_undegraded":"2024-09-12T21:56:57.105099+0000","last_fullsized":"2024-09-12T21:56:57.105099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.105002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.105002+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.105002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:40.357163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.723852+0000","last_change":"2024-09-12T21:56:53.723876+0000","last_active":"2024-09-12T21:56:53.723852+0000","last_peered":"2024-09-12T21:56:53.723852+0000","last_clean":"2024-09-12T21:56:53.723852+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:53.723852+0000","last_undegraded":"2024-09-12T21:56:53.723852+0000","last_fullsized":"2024-09-12T21:56:53.723852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.723765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.723765+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.723765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:22.965538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:04.182456+0000","last_change":"2024-09-12T21:57:04.182494+0000","last_active":"2024-09-12T21:57:04.182456+0000","last_peered":"2024-09-12T21:57:04.182456+0000","last_clean":"2024-09-12T21:57:04.182456+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:57:04.182456+0000","last_undegraded":"2024-09-12T21:57:04.182456+0000","last_fullsized":"2024-09-12T21:57:04.182456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:04.182370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:04.182370+0000","last_clean_scrub_stamp":"2024-09-12T21:57:04.182370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:28.707599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.600647+0000","last_change":"2024-09-12T21:56:59.600671+0000","last_active":"2024-09-12T21:56:59.600647+0000","last_peered":"2024-09-12T21:56:59.600647+0000","last_clean":"2024-09-12T21:56:59.600647+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:59.600647+0000","last_undegraded":"2024-09-12T21:56:59.600647+0000","last_fullsized":"2024-09-12T21:56:59.600647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.600525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.600525+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.600525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:04.283150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":363,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.908665+0000","last_change":"2024-09-12T21:56:33.318699+0000","last_active":"2024-09-12T21:56:41.908665+0000","last_peered":"2024-09-12T21:56:41.908665+0000","last_clean":"2024-09-12T21:56:41.908665+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:56:41.908665+0000","last_undegraded":"2024-09-12T21:56:41.908665+0000","last_fullsized":"2024-09-12T21:56:41.908665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:29.696180+0000","last_clean_scrub_stamp":"2024-09-12T21:50:29.696180+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909191+0000","last_change":"2024-09-12T21:56:33.327756+0000","last_active":"2024-09-12T21:56:41.909191+0000","last_peered":"2024-09-12T21:56:41.909191+0000","last_clean":"2024-09-12T21:56:41.909191+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:56:41.909191+0000","last_undegraded":"2024-09-12T21:56:41.909191+0000","last_fullsized":"2024-09-12T21:56:41.909191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":169,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.629917+0000","last_change":"2024-09-12T21:57:01.629956+0000","last_active":"2024-09-12T21:57:01.629917+0000","last_peered":"2024-09-12T21:57:01.629917+0000","last_clean":"2024-09-12T21:57:01.629917+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:57:01.629917+0000","last_undegraded":"2024-09-12T21:57:01.629917+0000","last_fullsized":"2024-09-12T21:57:01.629917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:01.629769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:01.629769+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.629769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:28.390680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909863+0000","last_change":"2024-09-12T21:56:33.327544+0000","last_active":"2024-09-12T21:56:41.909863+0000","last_peered":"2024-09-12T21:56:41.909863+0000","last_clean":"2024-09-12T21:56:41.909863+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:56:41.909863+0000","last_undegraded":"2024-09-12T21:56:41.909863+0000","last_fullsized":"2024-09-12T21:56:41.909863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.791101+0000","last_change":"2024-09-12T21:56:49.791140+0000","last_active":"2024-09-12T21:56:49.791101+0000","last_peered":"2024-09-12T21:56:49.791101+0000","last_clean":"2024-09-12T21:56:49.791101+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:49.791101+0000","last_undegraded":"2024-09-12T21:56:49.791101+0000","last_fullsized":"2024-09-12T21:56:49.791101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:49.791008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:49.791008+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.791008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:19.212447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.685177+0000","last_change":"2024-09-12T21:56:52.685177+0000","last_active":"2024-09-12T21:56:52.685177+0000","last_peered":"2024-09-12T21:56:52.685177+0000","last_clean":"2024-09-12T21:56:52.685177+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:52.685177+0000","last_undegraded":"2024-09-12T21:56:52.685177+0000","last_fullsized":"2024-09-12T21:56:52.685177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.685066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.685066+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.685066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:18.354993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.104724+0000","last_change":"2024-09-12T21:56:56.104751+0000","last_active":"2024-09-12T21:56:56.104724+0000","last_peered":"2024-09-12T21:56:56.104724+0000","last_clean":"2024-09-12T21:56:56.104724+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:56.104724+0000","last_undegraded":"2024-09-12T21:56:56.104724+0000","last_fullsized":"2024-09-12T21:56:56.104724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.104628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.104628+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.104628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.216230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.154057+0000","last_change":"2024-09-12T21:53:58.008756+0000","last_active":"2024-09-12T21:56:48.154057+0000","last_peered":"2024-09-12T21:56:48.154057+0000","last_clean":"2024-09-12T21:56:48.154057+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:56:48.154057+0000","last_undegraded":"2024-09-12T21:56:48.154057+0000","last_fullsized":"2024-09-12T21:56:48.154057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351472+0000","last_change":"2024-09-12T21:56:33.322622+0000","last_active":"2024-09-12T21:56:41.351472+0000","last_peered":"2024-09-12T21:56:41.351472+0000","last_clean":"2024-09-12T21:56:41.351472+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:56:41.351472+0000","last_undegraded":"2024-09-12T21:56:41.351472+0000","last_fullsized":"2024-09-12T21:56:41.351472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.581131+0000","last_change":"2024-09-12T21:56:57.581177+0000","last_active":"2024-09-12T21:56:57.581131+0000","last_peered":"2024-09-12T21:56:57.581131+0000","last_clean":"2024-09-12T21:56:57.581131+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:57.581131+0000","last_undegraded":"2024-09-12T21:56:57.581131+0000","last_fullsized":"2024-09-12T21:56:57.581131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.581028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.581028+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.581028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:56.283699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"87'3","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.893758+0000","last_change":"2024-09-12T21:57:03.893791+0000","last_active":"2024-09-12T21:57:03.893758+0000","last_peered":"2024-09-12T21:57:03.893758+0000","last_clean":"2024-09-12T21:57:03.893758+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:57:03.893758+0000","last_undegraded":"2024-09-12T21:57:03.893758+0000","last_fullsized":"2024-09-12T21:57:03.893758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:03.893666+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:03.893666+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.893666+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:22.752348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.786374+0000","last_change":"2024-09-12T21:56:56.786397+0000","last_active":"2024-09-12T21:56:56.786374+0000","last_peered":"2024-09-12T21:56:56.786374+0000","last_clean":"2024-09-12T21:56:56.786374+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:56.786374+0000","last_undegraded":"2024-09-12T21:56:56.786374+0000","last_fullsized":"2024-09-12T21:56:56.786374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.786244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.786244+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.786244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:24.933436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.154341+0000","last_change":"2024-09-12T21:53:58.009383+0000","last_active":"2024-09-12T21:56:48.154341+0000","last_peered":"2024-09-12T21:56:48.154341+0000","last_clean":"2024-09-12T21:56:48.154341+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:56:48.154341+0000","last_undegraded":"2024-09-12T21:56:48.154341+0000","last_fullsized":"2024-09-12T21:56:48.154341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.842248+0000","last_change":"2024-09-12T21:57:00.842273+0000","last_active":"2024-09-12T21:57:00.842248+0000","last_peered":"2024-09-12T21:57:00.842248+0000","last_clean":"2024-09-12T21:57:00.842248+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:57:00.842248+0000","last_undegraded":"2024-09-12T21:57:00.842248+0000","last_fullsized":"2024-09-12T21:57:00.842248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.842162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.842162+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.842162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:17.013903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.643629+0000","last_change":"2024-09-12T21:56:53.643670+0000","last_active":"2024-09-12T21:56:53.643629+0000","last_peered":"2024-09-12T21:56:53.643629+0000","last_clean":"2024-09-12T21:56:53.643629+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:53.643629+0000","last_undegraded":"2024-09-12T21:56:53.643629+0000","last_fullsized":"2024-09-12T21:56:53.643629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.643531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.643531+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.643531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:12.117896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.026557+0000","last_change":"2024-09-12T21:56:50.026617+0000","last_active":"2024-09-12T21:56:50.026557+0000","last_peered":"2024-09-12T21:56:50.026557+0000","last_clean":"2024-09-12T21:56:50.026557+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:50.026557+0000","last_undegraded":"2024-09-12T21:56:50.026557+0000","last_fullsized":"2024-09-12T21:56:50.026557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.026460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.026460+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.026460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:23.445265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":169,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.641373+0000","last_change":"2024-09-12T21:56:55.641409+0000","last_active":"2024-09-12T21:56:55.641373+0000","last_peered":"2024-09-12T21:56:55.641373+0000","last_clean":"2024-09-12T21:56:55.641373+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:55.641373+0000","last_undegraded":"2024-09-12T21:56:55.641373+0000","last_fullsized":"2024-09-12T21:56:55.641373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:55.641227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:55.641227+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.641227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:53.458440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352706+0000","last_change":"2024-09-12T21:53:58.007688+0000","last_active":"2024-09-12T21:56:41.352706+0000","last_peered":"2024-09-12T21:56:41.352706+0000","last_clean":"2024-09-12T21:56:41.352706+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:56:41.352706+0000","last_undegraded":"2024-09-12T21:56:41.352706+0000","last_fullsized":"2024-09-12T21:56:41.352706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:33.704973+0000","last_clean_scrub_stamp":"2024-09-12T21:50:33.704973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351813+0000","last_change":"2024-09-12T21:56:33.320969+0000","last_active":"2024-09-12T21:56:41.351813+0000","last_peered":"2024-09-12T21:56:41.351813+0000","last_clean":"2024-09-12T21:56:41.351813+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:56:41.351813+0000","last_undegraded":"2024-09-12T21:56:41.351813+0000","last_fullsized":"2024-09-12T21:56:41.351813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'3","reported_seq":171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.727539+0000","last_change":"2024-09-12T21:56:49.727586+0000","last_active":"2024-09-12T21:56:49.727539+0000","last_peered":"2024-09-12T21:56:49.727539+0000","last_clean":"2024-09-12T21:56:49.727539+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:49.727539+0000","last_undegraded":"2024-09-12T21:56:49.727539+0000","last_fullsized":"2024-09-12T21:56:49.727539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:56:49.727428+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:56:49.727428+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.727428+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:02.863846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.732399+0000","last_change":"2024-09-12T21:56:50.732399+0000","last_active":"2024-09-12T21:56:50.732399+0000","last_peered":"2024-09-12T21:56:50.732399+0000","last_clean":"2024-09-12T21:56:50.732399+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:50.732399+0000","last_undegraded":"2024-09-12T21:56:50.732399+0000","last_fullsized":"2024-09-12T21:56:50.732399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.732234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.732234+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.732234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351345+0000","last_change":"2024-09-12T21:56:33.326730+0000","last_active":"2024-09-12T21:56:41.351345+0000","last_peered":"2024-09-12T21:56:41.351345+0000","last_clean":"2024-09-12T21:56:41.351345+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:56:41.351345+0000","last_undegraded":"2024-09-12T21:56:41.351345+0000","last_fullsized":"2024-09-12T21:56:41.351345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"87'2","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.674892+0000","last_change":"2024-09-12T21:56:54.674960+0000","last_active":"2024-09-12T21:56:54.674892+0000","last_peered":"2024-09-12T21:56:54.674892+0000","last_clean":"2024-09-12T21:56:54.674892+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:54.674892+0000","last_undegraded":"2024-09-12T21:56:54.674892+0000","last_fullsized":"2024-09-12T21:56:54.674892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:56:54.674791+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:56:54.674791+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.674791+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.446282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:05.845984+0000","last_change":"2024-09-12T21:57:05.846013+0000","last_active":"2024-09-12T21:57:05.845984+0000","last_peered":"2024-09-12T21:57:05.845984+0000","last_clean":"2024-09-12T21:57:05.845984+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:57:05.845984+0000","last_undegraded":"2024-09-12T21:57:05.845984+0000","last_fullsized":"2024-09-12T21:57:05.845984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:05.845893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:05.845893+0000","last_clean_scrub_stamp":"2024-09-12T21:57:05.845893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:12.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.014342+0000","last_change":"2024-09-12T21:56:51.014365+0000","last_active":"2024-09-12T21:56:51.014342+0000","last_peered":"2024-09-12T21:56:51.014342+0000","last_clean":"2024-09-12T21:56:51.014342+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:51.014342+0000","last_undegraded":"2024-09-12T21:56:51.014342+0000","last_fullsized":"2024-09-12T21:56:51.014342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:51.014257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:51.014257+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.014257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:40.812665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.745177+0000","last_change":"2024-09-12T21:56:50.745200+0000","last_active":"2024-09-12T21:56:50.745177+0000","last_peered":"2024-09-12T21:56:50.745177+0000","last_clean":"2024-09-12T21:56:50.745177+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:50.745177+0000","last_undegraded":"2024-09-12T21:56:50.745177+0000","last_fullsized":"2024-09-12T21:56:50.745177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.745086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.745086+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.745086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:57.670416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909276+0000","last_change":"2024-09-12T21:56:33.319685+0000","last_active":"2024-09-12T21:56:41.909276+0000","last_peered":"2024-09-12T21:56:41.909276+0000","last_clean":"2024-09-12T21:56:41.909276+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:56:41.909276+0000","last_undegraded":"2024-09-12T21:56:41.909276+0000","last_fullsized":"2024-09-12T21:56:41.909276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351280+0000","last_change":"2024-09-12T21:53:58.009621+0000","last_active":"2024-09-12T21:56:41.351280+0000","last_peered":"2024-09-12T21:56:41.351280+0000","last_clean":"2024-09-12T21:56:41.351280+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:56:41.351280+0000","last_undegraded":"2024-09-12T21:56:41.351280+0000","last_fullsized":"2024-09-12T21:56:41.351280+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352617+0000","last_change":"2024-09-12T21:56:33.329336+0000","last_active":"2024-09-12T21:56:41.352617+0000","last_peered":"2024-09-12T21:56:41.352617+0000","last_clean":"2024-09-12T21:56:41.352617+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:56:41.352617+0000","last_undegraded":"2024-09-12T21:56:41.352617+0000","last_fullsized":"2024-09-12T21:56:41.352617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909783+0000","last_change":"2024-09-12T21:56:33.319780+0000","last_active":"2024-09-12T21:56:41.909783+0000","last_peered":"2024-09-12T21:56:41.909783+0000","last_clean":"2024-09-12T21:56:41.909783+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:56:41.909783+0000","last_undegraded":"2024-09-12T21:56:41.909783+0000","last_fullsized":"2024-09-12T21:56:41.909783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.619023+0000","last_change":"2024-09-12T21:56:56.619081+0000","last_active":"2024-09-12T21:56:56.619023+0000","last_peered":"2024-09-12T21:56:56.619023+0000","last_clean":"2024-09-12T21:56:56.619023+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:56.619023+0000","last_undegraded":"2024-09-12T21:56:56.619023+0000","last_fullsized":"2024-09-12T21:56:56.619023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.618924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.618924+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.618924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:25.987060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352315+0000","last_change":"2024-09-12T21:56:33.323093+0000","last_active":"2024-09-12T21:56:41.352315+0000","last_peered":"2024-09-12T21:56:41.352315+0000","last_clean":"2024-09-12T21:56:41.352315+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:56:41.352315+0000","last_undegraded":"2024-09-12T21:56:41.352315+0000","last_fullsized":"2024-09-12T21:56:41.352315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351268+0000","last_change":"2024-09-12T21:53:58.005699+0000","last_active":"2024-09-12T21:56:41.351268+0000","last_peered":"2024-09-12T21:56:41.351268+0000","last_clean":"2024-09-12T21:56:41.351268+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:56:41.351268+0000","last_undegraded":"2024-09-12T21:56:41.351268+0000","last_fullsized":"2024-09-12T21:56:41.351268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352511+0000","last_change":"2024-09-12T21:56:33.328546+0000","last_active":"2024-09-12T21:56:41.352511+0000","last_peered":"2024-09-12T21:56:41.352511+0000","last_clean":"2024-09-12T21:56:41.352511+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:56:41.352511+0000","last_undegraded":"2024-09-12T21:56:41.352511+0000","last_fullsized":"2024-09-12T21:56:41.352511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351405+0000","last_change":"2024-09-12T21:53:58.005808+0000","last_active":"2024-09-12T21:56:41.351405+0000","last_peered":"2024-09-12T21:56:41.351405+0000","last_clean":"2024-09-12T21:56:41.351405+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:56:41.351405+0000","last_undegraded":"2024-09-12T21:56:41.351405+0000","last_fullsized":"2024-09-12T21:56:41.351405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.621445+0000","last_change":"2024-09-12T21:57:02.621468+0000","last_active":"2024-09-12T21:57:02.621445+0000","last_peered":"2024-09-12T21:57:02.621445+0000","last_clean":"2024-09-12T21:57:02.621445+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:57:02.621445+0000","last_undegraded":"2024-09-12T21:57:02.621445+0000","last_fullsized":"2024-09-12T21:57:02.621445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:02.621324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:02.621324+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.621324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:31.580839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.604279+0000","last_change":"2024-09-12T21:57:00.604304+0000","last_active":"2024-09-12T21:57:00.604279+0000","last_peered":"2024-09-12T21:57:00.604279+0000","last_clean":"2024-09-12T21:57:00.604279+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:57:00.604279+0000","last_undegraded":"2024-09-12T21:57:00.604279+0000","last_fullsized":"2024-09-12T21:57:00.604279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.604194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.604194+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.604194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:00.231154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352541+0000","last_change":"2024-09-12T21:56:33.330211+0000","last_active":"2024-09-12T21:56:41.352541+0000","last_peered":"2024-09-12T21:56:41.352541+0000","last_clean":"2024-09-12T21:56:41.352541+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:56:41.352541+0000","last_undegraded":"2024-09-12T21:56:41.352541+0000","last_fullsized":"2024-09-12T21:56:41.352541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352117+0000","last_change":"2024-09-12T21:53:58.007435+0000","last_active":"2024-09-12T21:56:41.352117+0000","last_peered":"2024-09-12T21:56:41.352117+0000","last_clean":"2024-09-12T21:56:41.352117+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:56:41.352117+0000","last_undegraded":"2024-09-12T21:56:41.352117+0000","last_fullsized":"2024-09-12T21:56:41.352117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352093+0000","last_change":"2024-09-12T21:53:58.008009+0000","last_active":"2024-09-12T21:56:41.352093+0000","last_peered":"2024-09-12T21:56:41.352093+0000","last_clean":"2024-09-12T21:56:41.352093+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:56:41.352093+0000","last_undegraded":"2024-09-12T21:56:41.352093+0000","last_fullsized":"2024-09-12T21:56:41.352093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.055622+0000","last_change":"2024-09-12T21:56:55.055647+0000","last_active":"2024-09-12T21:56:55.055622+0000","last_peered":"2024-09-12T21:56:55.055622+0000","last_clean":"2024-09-12T21:56:55.055622+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:55.055622+0000","last_undegraded":"2024-09-12T21:56:55.055622+0000","last_fullsized":"2024-09-12T21:56:55.055622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T21:56:55.055532+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T21:56:55.055532+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.055532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:25.198312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909372+0000","last_change":"2024-09-12T21:56:33.325778+0000","last_active":"2024-09-12T21:56:41.909372+0000","last_peered":"2024-09-12T21:56:41.909372+0000","last_clean":"2024-09-12T21:56:41.909372+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:56:41.909372+0000","last_undegraded":"2024-09-12T21:56:41.909372+0000","last_fullsized":"2024-09-12T21:56:41.909372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.909280+0000","last_change":"2024-09-12T21:56:33.320039+0000","last_active":"2024-09-12T21:56:41.909280+0000","last_peered":"2024-09-12T21:56:41.909280+0000","last_clean":"2024-09-12T21:56:41.909280+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:56:41.909280+0000","last_undegraded":"2024-09-12T21:56:41.909280+0000","last_fullsized":"2024-09-12T21:56:41.909280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.690058+0000","last_change":"2024-09-12T21:56:54.690083+0000","last_active":"2024-09-12T21:56:54.690058+0000","last_peered":"2024-09-12T21:56:54.690058+0000","last_clean":"2024-09-12T21:56:54.690058+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:54.690058+0000","last_undegraded":"2024-09-12T21:56:54.690058+0000","last_fullsized":"2024-09-12T21:56:54.690058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:54.689960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:54.689960+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.689960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:42.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.352198+0000","last_change":"2024-09-12T21:56:33.329215+0000","last_active":"2024-09-12T21:56:41.352198+0000","last_peered":"2024-09-12T21:56:41.352198+0000","last_clean":"2024-09-12T21:56:41.352198+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:56:41.352198+0000","last_undegraded":"2024-09-12T21:56:41.352198+0000","last_fullsized":"2024-09-12T21:56:41.352198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:41.351760+0000","last_change":"2024-09-12T21:53:58.007846+0000","last_active":"2024-09-12T21:56:41.351760+0000","last_peered":"2024-09-12T21:56:41.351760+0000","last_clean":"2024-09-12T21:56:41.351760+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:56:41.351760+0000","last_undegraded":"2024-09-12T21:56:41.351760+0000","last_fullsized":"2024-09-12T21:56:41.351760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:38.831158+0000","last_clean_scrub_stamp":"2024-09-12T21:50:38.831158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.721395+0000","last_change":"2024-09-12T21:56:48.721454+0000","last_active":"2024-09-12T21:56:48.721395+0000","last_peered":"2024-09-12T21:56:48.721395+0000","last_clean":"2024-09-12T21:56:48.721395+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:48.721395+0000","last_undegraded":"2024-09-12T21:56:48.721395+0000","last_fullsized":"2024-09-12T21:56:48.721395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T21:56:48.721288+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T21:56:48.721288+0000","last_clean_scrub_stamp":"2024-09-12T21:56:48.721288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:53.437016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.739559+0000","last_change":"2024-09-12T21:56:55.739586+0000","last_active":"2024-09-12T21:56:55.739559+0000","last_peered":"2024-09-12T21:56:55.739559+0000","last_clean":"2024-09-12T21:56:55.739559+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:55.739559+0000","last_undegraded":"2024-09-12T21:56:55.739559+0000","last_fullsized":"2024-09-12T21:56:55.739559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:55.739464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:55.739464+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.739464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:01.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.154292+0000","last_change":"2024-09-12T21:56:33.323013+0000","last_active":"2024-09-12T21:56:48.154292+0000","last_peered":"2024-09-12T21:56:48.154292+0000","last_clean":"2024-09-12T21:56:48.154292+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:56:48.154292+0000","last_undegraded":"2024-09-12T21:56:48.154292+0000","last_fullsized":"2024-09-12T21:56:48.154292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:50:37.827303+0000","last_clean_scrub_stamp":"2024-09-12T21:50:37.827303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645352,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41084,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330756,"statfs":{"total":96636764160,"available":96594694144,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738451,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437548,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934292,"statfs":{"total":96636764160,"available":96188715008,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383689,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62728,"kb_used_data":1592,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309112,"statfs":{"total":96636764160,"available":96572530688,"internally_reserved":0,"allocated":1630208,"data_stored":989607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:57:09.270 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.270 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.271 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.272 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.273 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T21:50:29.696180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.274 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T21:50:33.704973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.275 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.276 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T21:50:38.831158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T21:50:37.827303+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=50, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=21, tm_min=56, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T21:57:09.277 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T21:57:29.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T21:57:29.588 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:57:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-12T21:57:29.598 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-12T21:57:28.978966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541360,"kb_used_data":4160,"kb_used_omap":14,"kb_used_meta":537137,"kb_avail":282574160,"statfs":{"total":289910292480,"available":289355939840,"internally_reserved":0,"allocated":4259840,"data_stored":2376024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14737,"internal_metadata":550028911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004015"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:14.936544+0000","last_change":"2024-09-12T21:57:14.936581+0000","last_active":"2024-09-12T21:57:14.936544+0000","last_peered":"2024-09-12T21:57:14.936544+0000","last_clean":"2024-09-12T21:57:14.936544+0000","last_became_active":"2024-09-12T21:53:58.007267+0000","last_became_peered":"2024-09-12T21:53:58.007267+0000","last_unstale":"2024-09-12T21:57:14.936544+0000","last_undegraded":"2024-09-12T21:57:14.936544+0000","last_fullsized":"2024-09-12T21:57:14.936544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:14.936439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:14.936439+0000","last_clean_scrub_stamp":"2024-09-12T21:57:14.936439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:26.696111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.099711+0000","last_change":"2024-09-12T21:56:58.099736+0000","last_active":"2024-09-12T21:56:58.099711+0000","last_peered":"2024-09-12T21:56:58.099711+0000","last_clean":"2024-09-12T21:56:58.099711+0000","last_became_active":"2024-09-12T21:53:58.008079+0000","last_became_peered":"2024-09-12T21:53:58.008079+0000","last_unstale":"2024-09-12T21:56:58.099711+0000","last_undegraded":"2024-09-12T21:56:58.099711+0000","last_fullsized":"2024-09-12T21:56:58.099711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.099579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.099579+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.099579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:06.450290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:23.784104+0000","last_change":"2024-09-12T21:57:23.784130+0000","last_active":"2024-09-12T21:57:23.784104+0000","last_peered":"2024-09-12T21:57:23.784104+0000","last_clean":"2024-09-12T21:57:23.784104+0000","last_became_active":"2024-09-12T21:56:33.327979+0000","last_became_peered":"2024-09-12T21:56:33.327979+0000","last_unstale":"2024-09-12T21:57:23.784104+0000","last_undegraded":"2024-09-12T21:57:23.784104+0000","last_fullsized":"2024-09-12T21:57:23.784104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:23.784015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:23.784015+0000","last_clean_scrub_stamp":"2024-09-12T21:57:23.784015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:36.293047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:15.720518+0000","last_change":"2024-09-12T21:57:15.720541+0000","last_active":"2024-09-12T21:57:15.720518+0000","last_peered":"2024-09-12T21:57:15.720518+0000","last_clean":"2024-09-12T21:57:15.720518+0000","last_became_active":"2024-09-12T21:56:33.319439+0000","last_became_peered":"2024-09-12T21:56:33.319439+0000","last_unstale":"2024-09-12T21:57:15.720518+0000","last_undegraded":"2024-09-12T21:57:15.720518+0000","last_fullsized":"2024-09-12T21:57:15.720518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:15.720397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:15.720397+0000","last_clean_scrub_stamp":"2024-09-12T21:57:15.720397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:23:37.715783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:12.043981+0000","last_change":"2024-09-12T21:57:12.044003+0000","last_active":"2024-09-12T21:57:12.043981+0000","last_peered":"2024-09-12T21:57:12.043981+0000","last_clean":"2024-09-12T21:57:12.043981+0000","last_became_active":"2024-09-12T21:53:58.006901+0000","last_became_peered":"2024-09-12T21:53:58.006901+0000","last_unstale":"2024-09-12T21:57:12.043981+0000","last_undegraded":"2024-09-12T21:57:12.043981+0000","last_fullsized":"2024-09-12T21:57:12.043981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:12.043894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:12.043894+0000","last_clean_scrub_stamp":"2024-09-12T21:57:12.043894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:55.549374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:06.828682+0000","last_change":"2024-09-12T21:57:06.828707+0000","last_active":"2024-09-12T21:57:06.828682+0000","last_peered":"2024-09-12T21:57:06.828682+0000","last_clean":"2024-09-12T21:57:06.828682+0000","last_became_active":"2024-09-12T21:56:33.321222+0000","last_became_peered":"2024-09-12T21:56:33.321222+0000","last_unstale":"2024-09-12T21:57:06.828682+0000","last_undegraded":"2024-09-12T21:57:06.828682+0000","last_fullsized":"2024-09-12T21:57:06.828682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:06.828595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:06.828595+0000","last_clean_scrub_stamp":"2024-09-12T21:57:06.828595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:40.245621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:14.752292+0000","last_change":"2024-09-12T21:57:14.752315+0000","last_active":"2024-09-12T21:57:14.752292+0000","last_peered":"2024-09-12T21:57:14.752292+0000","last_clean":"2024-09-12T21:57:14.752292+0000","last_became_active":"2024-09-12T21:56:33.319782+0000","last_became_peered":"2024-09-12T21:56:33.319782+0000","last_unstale":"2024-09-12T21:57:14.752292+0000","last_undegraded":"2024-09-12T21:57:14.752292+0000","last_fullsized":"2024-09-12T21:57:14.752292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:14.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:14.752203+0000","last_clean_scrub_stamp":"2024-09-12T21:57:14.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:55.881274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.853449+0000","last_change":"2024-09-12T21:57:01.853473+0000","last_active":"2024-09-12T21:57:01.853449+0000","last_peered":"2024-09-12T21:57:01.853449+0000","last_clean":"2024-09-12T21:57:01.853449+0000","last_became_active":"2024-09-12T21:56:33.321029+0000","last_became_peered":"2024-09-12T21:56:33.321029+0000","last_unstale":"2024-09-12T21:57:01.853449+0000","last_undegraded":"2024-09-12T21:57:01.853449+0000","last_fullsized":"2024-09-12T21:57:01.853449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:01.853327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:01.853327+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.853327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:02.342210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:09.558730+0000","last_change":"2024-09-12T21:57:09.558753+0000","last_active":"2024-09-12T21:57:09.558730+0000","last_peered":"2024-09-12T21:57:09.558730+0000","last_clean":"2024-09-12T21:57:09.558730+0000","last_became_active":"2024-09-12T21:53:58.008325+0000","last_became_peered":"2024-09-12T21:53:58.008325+0000","last_unstale":"2024-09-12T21:57:09.558730+0000","last_undegraded":"2024-09-12T21:57:09.558730+0000","last_fullsized":"2024-09-12T21:57:09.558730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:09.558628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:09.558628+0000","last_clean_scrub_stamp":"2024-09-12T21:57:09.558628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:33.684011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.075650+0000","last_change":"2024-09-12T21:56:54.075696+0000","last_active":"2024-09-12T21:56:54.075650+0000","last_peered":"2024-09-12T21:56:54.075650+0000","last_clean":"2024-09-12T21:56:54.075650+0000","last_became_active":"2024-09-12T21:53:58.008458+0000","last_became_peered":"2024-09-12T21:53:58.008458+0000","last_unstale":"2024-09-12T21:56:54.075650+0000","last_undegraded":"2024-09-12T21:56:54.075650+0000","last_fullsized":"2024-09-12T21:56:54.075650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:54.075547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:54.075547+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.075547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:57.914685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:17.683403+0000","last_change":"2024-09-12T21:57:17.683453+0000","last_active":"2024-09-12T21:57:17.683403+0000","last_peered":"2024-09-12T21:57:17.683403+0000","last_clean":"2024-09-12T21:57:17.683403+0000","last_became_active":"2024-09-12T21:56:33.325076+0000","last_became_peered":"2024-09-12T21:56:33.325076+0000","last_unstale":"2024-09-12T21:57:17.683403+0000","last_undegraded":"2024-09-12T21:57:17.683403+0000","last_fullsized":"2024-09-12T21:57:17.683403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:17.683307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:17.683307+0000","last_clean_scrub_stamp":"2024-09-12T21:57:17.683307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:35.902443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.145945+0000","last_change":"2024-09-12T21:56:59.145969+0000","last_active":"2024-09-12T21:56:59.145945+0000","last_peered":"2024-09-12T21:56:59.145945+0000","last_clean":"2024-09-12T21:56:59.145945+0000","last_became_active":"2024-09-12T21:56:33.319901+0000","last_became_peered":"2024-09-12T21:56:33.319901+0000","last_unstale":"2024-09-12T21:56:59.145945+0000","last_undegraded":"2024-09-12T21:56:59.145945+0000","last_fullsized":"2024-09-12T21:56:59.145945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.145857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.145857+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.145857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:58.244227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:13.967598+0000","last_change":"2024-09-12T21:57:13.967624+0000","last_active":"2024-09-12T21:57:13.967598+0000","last_peered":"2024-09-12T21:57:13.967598+0000","last_clean":"2024-09-12T21:57:13.967598+0000","last_became_active":"2024-09-12T21:53:58.007256+0000","last_became_peered":"2024-09-12T21:53:58.007256+0000","last_unstale":"2024-09-12T21:57:13.967598+0000","last_undegraded":"2024-09-12T21:57:13.967598+0000","last_fullsized":"2024-09-12T21:57:13.967598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:13.967466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:13.967466+0000","last_clean_scrub_stamp":"2024-09-12T21:57:13.967466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:36.324054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:21.747317+0000","last_change":"2024-09-12T21:57:21.747353+0000","last_active":"2024-09-12T21:57:21.747317+0000","last_peered":"2024-09-12T21:57:21.747317+0000","last_clean":"2024-09-12T21:57:21.747317+0000","last_became_active":"2024-09-12T21:56:33.327709+0000","last_became_peered":"2024-09-12T21:56:33.327709+0000","last_unstale":"2024-09-12T21:57:21.747317+0000","last_undegraded":"2024-09-12T21:57:21.747317+0000","last_fullsized":"2024-09-12T21:57:21.747317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:21.747189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:21.747189+0000","last_clean_scrub_stamp":"2024-09-12T21:57:21.747189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:19.102242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:09.775634+0000","last_change":"2024-09-12T21:57:09.775659+0000","last_active":"2024-09-12T21:57:09.775634+0000","last_peered":"2024-09-12T21:57:09.775634+0000","last_clean":"2024-09-12T21:57:09.775634+0000","last_became_active":"2024-09-12T21:56:33.318548+0000","last_became_peered":"2024-09-12T21:56:33.318548+0000","last_unstale":"2024-09-12T21:57:09.775634+0000","last_undegraded":"2024-09-12T21:57:09.775634+0000","last_fullsized":"2024-09-12T21:57:09.775634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:09.775546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:09.775546+0000","last_clean_scrub_stamp":"2024-09-12T21:57:09.775546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:52.455278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.779558+0000","last_change":"2024-09-12T21:56:58.779580+0000","last_active":"2024-09-12T21:56:58.779558+0000","last_peered":"2024-09-12T21:56:58.779558+0000","last_clean":"2024-09-12T21:56:58.779558+0000","last_became_active":"2024-09-12T21:56:33.323044+0000","last_became_peered":"2024-09-12T21:56:33.323044+0000","last_unstale":"2024-09-12T21:56:58.779558+0000","last_undegraded":"2024-09-12T21:56:58.779558+0000","last_fullsized":"2024-09-12T21:56:58.779558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.779439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.779439+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.779439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:31.829649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.729295+0000","last_change":"2024-09-12T21:56:51.729330+0000","last_active":"2024-09-12T21:56:51.729295+0000","last_peered":"2024-09-12T21:56:51.729295+0000","last_clean":"2024-09-12T21:56:51.729295+0000","last_became_active":"2024-09-12T21:53:58.011089+0000","last_became_peered":"2024-09-12T21:53:58.011089+0000","last_unstale":"2024-09-12T21:56:51.729295+0000","last_undegraded":"2024-09-12T21:56:51.729295+0000","last_fullsized":"2024-09-12T21:56:51.729295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:51.729158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:51.729158+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.729158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:16.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.172354+0000","last_change":"2024-09-12T21:57:02.172385+0000","last_active":"2024-09-12T21:57:02.172354+0000","last_peered":"2024-09-12T21:57:02.172354+0000","last_clean":"2024-09-12T21:57:02.172354+0000","last_became_active":"2024-09-12T21:53:58.007772+0000","last_became_peered":"2024-09-12T21:53:58.007772+0000","last_unstale":"2024-09-12T21:57:02.172354+0000","last_undegraded":"2024-09-12T21:57:02.172354+0000","last_fullsized":"2024-09-12T21:57:02.172354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:02.172258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:02.172258+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.172258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:36.354040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:10.566060+0000","last_change":"2024-09-12T21:57:10.566060+0000","last_active":"2024-09-12T21:57:10.566060+0000","last_peered":"2024-09-12T21:57:10.566060+0000","last_clean":"2024-09-12T21:57:10.566060+0000","last_became_active":"2024-09-12T21:53:58.008299+0000","last_became_peered":"2024-09-12T21:53:58.008299+0000","last_unstale":"2024-09-12T21:57:10.566060+0000","last_undegraded":"2024-09-12T21:57:10.566060+0000","last_fullsized":"2024-09-12T21:57:10.566060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:10.565950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:10.565950+0000","last_clean_scrub_stamp":"2024-09-12T21:57:10.565950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:59.118097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:07.842926+0000","last_change":"2024-09-12T21:57:07.842965+0000","last_active":"2024-09-12T21:57:07.842926+0000","last_peered":"2024-09-12T21:57:07.842926+0000","last_clean":"2024-09-12T21:57:07.842926+0000","last_became_active":"2024-09-12T21:56:33.320021+0000","last_became_peered":"2024-09-12T21:56:33.320021+0000","last_unstale":"2024-09-12T21:57:07.842926+0000","last_undegraded":"2024-09-12T21:57:07.842926+0000","last_fullsized":"2024-09-12T21:57:07.842926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:07.842834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:07.842834+0000","last_clean_scrub_stamp":"2024-09-12T21:57:07.842834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:46.057954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:18.696580+0000","last_change":"2024-09-12T21:57:18.696606+0000","last_active":"2024-09-12T21:57:18.696580+0000","last_peered":"2024-09-12T21:57:18.696580+0000","last_clean":"2024-09-12T21:57:18.696580+0000","last_became_active":"2024-09-12T21:56:33.325579+0000","last_became_peered":"2024-09-12T21:56:33.325579+0000","last_unstale":"2024-09-12T21:57:18.696580+0000","last_undegraded":"2024-09-12T21:57:18.696580+0000","last_fullsized":"2024-09-12T21:57:18.696580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:18.696479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:18.696479+0000","last_clean_scrub_stamp":"2024-09-12T21:57:18.696479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:09.529622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.047262+0000","last_change":"2024-09-12T21:56:49.047296+0000","last_active":"2024-09-12T21:56:49.047262+0000","last_peered":"2024-09-12T21:56:49.047262+0000","last_clean":"2024-09-12T21:56:49.047262+0000","last_became_active":"2024-09-12T21:56:33.320945+0000","last_became_peered":"2024-09-12T21:56:33.320945+0000","last_unstale":"2024-09-12T21:56:49.047262+0000","last_undegraded":"2024-09-12T21:56:49.047262+0000","last_fullsized":"2024-09-12T21:56:49.047262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:49.047176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:49.047176+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.047176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:58.697520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:12.609291+0000","last_change":"2024-09-12T21:57:12.609291+0000","last_active":"2024-09-12T21:57:12.609291+0000","last_peered":"2024-09-12T21:57:12.609291+0000","last_clean":"2024-09-12T21:57:12.609291+0000","last_became_active":"2024-09-12T21:56:33.321233+0000","last_became_peered":"2024-09-12T21:56:33.321233+0000","last_unstale":"2024-09-12T21:57:12.609291+0000","last_undegraded":"2024-09-12T21:57:12.609291+0000","last_fullsized":"2024-09-12T21:57:12.609291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:12.609149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:12.609149+0000","last_clean_scrub_stamp":"2024-09-12T21:57:12.609149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:40.875977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.179644+0000","last_change":"2024-09-12T21:57:00.179670+0000","last_active":"2024-09-12T21:57:00.179644+0000","last_peered":"2024-09-12T21:57:00.179644+0000","last_clean":"2024-09-12T21:57:00.179644+0000","last_became_active":"2024-09-12T21:53:58.008103+0000","last_became_peered":"2024-09-12T21:53:58.008103+0000","last_unstale":"2024-09-12T21:57:00.179644+0000","last_undegraded":"2024-09-12T21:57:00.179644+0000","last_fullsized":"2024-09-12T21:57:00.179644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.179558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.179558+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.179558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:46.164102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:17.922350+0000","last_change":"2024-09-12T21:57:17.922375+0000","last_active":"2024-09-12T21:57:17.922350+0000","last_peered":"2024-09-12T21:57:17.922350+0000","last_clean":"2024-09-12T21:57:17.922350+0000","last_became_active":"2024-09-12T21:56:33.321752+0000","last_became_peered":"2024-09-12T21:56:33.321752+0000","last_unstale":"2024-09-12T21:57:17.922350+0000","last_undegraded":"2024-09-12T21:57:17.922350+0000","last_fullsized":"2024-09-12T21:57:17.922350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:17.922267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:17.922267+0000","last_clean_scrub_stamp":"2024-09-12T21:57:17.922267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:13.467384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:13.608057+0000","last_change":"2024-09-12T21:57:13.608090+0000","last_active":"2024-09-12T21:57:13.608057+0000","last_peered":"2024-09-12T21:57:13.608057+0000","last_clean":"2024-09-12T21:57:13.608057+0000","last_became_active":"2024-09-12T21:56:33.321021+0000","last_became_peered":"2024-09-12T21:56:33.321021+0000","last_unstale":"2024-09-12T21:57:13.608057+0000","last_undegraded":"2024-09-12T21:57:13.608057+0000","last_fullsized":"2024-09-12T21:57:13.608057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:13.607969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:13.607969+0000","last_clean_scrub_stamp":"2024-09-12T21:57:13.607969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:01.153881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:22.759540+0000","last_change":"2024-09-12T21:57:22.759582+0000","last_active":"2024-09-12T21:57:22.759540+0000","last_peered":"2024-09-12T21:57:22.759540+0000","last_clean":"2024-09-12T21:57:22.759540+0000","last_became_active":"2024-09-12T21:56:33.327490+0000","last_became_peered":"2024-09-12T21:56:33.327490+0000","last_unstale":"2024-09-12T21:57:22.759540+0000","last_undegraded":"2024-09-12T21:57:22.759540+0000","last_fullsized":"2024-09-12T21:57:22.759540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:22.759433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:22.759433+0000","last_clean_scrub_stamp":"2024-09-12T21:57:22.759433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:02.794219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:07.085589+0000","last_change":"2024-09-12T21:57:07.085613+0000","last_active":"2024-09-12T21:57:07.085589+0000","last_peered":"2024-09-12T21:57:07.085589+0000","last_clean":"2024-09-12T21:57:07.085589+0000","last_became_active":"2024-09-12T21:56:33.320198+0000","last_became_peered":"2024-09-12T21:56:33.320198+0000","last_unstale":"2024-09-12T21:57:07.085589+0000","last_undegraded":"2024-09-12T21:57:07.085589+0000","last_fullsized":"2024-09-12T21:57:07.085589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:07.085482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:07.085482+0000","last_clean_scrub_stamp":"2024-09-12T21:57:07.085482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:43.883461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.606282+0000","last_change":"2024-09-12T21:57:03.606307+0000","last_active":"2024-09-12T21:57:03.606282+0000","last_peered":"2024-09-12T21:57:03.606282+0000","last_clean":"2024-09-12T21:57:03.606282+0000","last_became_active":"2024-09-12T21:53:58.009308+0000","last_became_peered":"2024-09-12T21:53:58.009308+0000","last_unstale":"2024-09-12T21:57:03.606282+0000","last_undegraded":"2024-09-12T21:57:03.606282+0000","last_fullsized":"2024-09-12T21:57:03.606282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:03.606151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:03.606151+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.606151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:45.891987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.063597+0000","last_change":"2024-09-12T21:56:52.063661+0000","last_active":"2024-09-12T21:56:52.063597+0000","last_peered":"2024-09-12T21:56:52.063597+0000","last_clean":"2024-09-12T21:56:52.063597+0000","last_became_active":"2024-09-12T21:56:33.320068+0000","last_became_peered":"2024-09-12T21:56:33.320068+0000","last_unstale":"2024-09-12T21:56:52.063597+0000","last_undegraded":"2024-09-12T21:56:52.063597+0000","last_fullsized":"2024-09-12T21:56:52.063597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.063500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.063500+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.063500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:30.621510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:06.621169+0000","last_change":"2024-09-12T21:57:06.621219+0000","last_active":"2024-09-12T21:57:06.621169+0000","last_peered":"2024-09-12T21:57:06.621169+0000","last_clean":"2024-09-12T21:57:06.621169+0000","last_became_active":"2024-09-12T21:53:58.005274+0000","last_became_peered":"2024-09-12T21:53:58.005274+0000","last_unstale":"2024-09-12T21:57:06.621169+0000","last_undegraded":"2024-09-12T21:57:06.621169+0000","last_fullsized":"2024-09-12T21:57:06.621169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:06.621055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:06.621055+0000","last_clean_scrub_stamp":"2024-09-12T21:57:06.621055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:49.961530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.741135+0000","last_change":"2024-09-12T21:56:52.741159+0000","last_active":"2024-09-12T21:56:52.741135+0000","last_peered":"2024-09-12T21:56:52.741135+0000","last_clean":"2024-09-12T21:56:52.741135+0000","last_became_active":"2024-09-12T21:56:33.321474+0000","last_became_peered":"2024-09-12T21:56:33.321474+0000","last_unstale":"2024-09-12T21:56:52.741135+0000","last_undegraded":"2024-09-12T21:56:52.741135+0000","last_fullsized":"2024-09-12T21:56:52.741135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.741046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.741046+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.741046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:25.193230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:11.085605+0000","last_change":"2024-09-12T21:57:11.085635+0000","last_active":"2024-09-12T21:57:11.085605+0000","last_peered":"2024-09-12T21:57:11.085605+0000","last_clean":"2024-09-12T21:57:11.085605+0000","last_became_active":"2024-09-12T21:53:58.006936+0000","last_became_peered":"2024-09-12T21:53:58.006936+0000","last_unstale":"2024-09-12T21:57:11.085605+0000","last_undegraded":"2024-09-12T21:57:11.085605+0000","last_fullsized":"2024-09-12T21:57:11.085605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:11.085501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:11.085501+0000","last_clean_scrub_stamp":"2024-09-12T21:57:11.085501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:01:57.288932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"87'4","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.905527+0000","last_change":"2024-09-12T21:57:02.905558+0000","last_active":"2024-09-12T21:57:02.905527+0000","last_peered":"2024-09-12T21:57:02.905527+0000","last_clean":"2024-09-12T21:57:02.905527+0000","last_became_active":"2024-09-12T21:56:33.322228+0000","last_became_peered":"2024-09-12T21:56:33.322228+0000","last_unstale":"2024-09-12T21:57:02.905527+0000","last_undegraded":"2024-09-12T21:57:02.905527+0000","last_fullsized":"2024-09-12T21:57:02.905527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'4","last_scrub_stamp":"2024-09-12T21:57:02.905431+0000","last_deep_scrub":"87'4","last_deep_scrub_stamp":"2024-09-12T21:57:02.905431+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.905431+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:43.771747+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:10.086067+0000","last_change":"2024-09-12T21:57:10.086106+0000","last_active":"2024-09-12T21:57:10.086067+0000","last_peered":"2024-09-12T21:57:10.086067+0000","last_clean":"2024-09-12T21:57:10.086067+0000","last_became_active":"2024-09-12T21:53:58.006792+0000","last_became_peered":"2024-09-12T21:53:58.006792+0000","last_unstale":"2024-09-12T21:57:10.086067+0000","last_undegraded":"2024-09-12T21:57:10.086067+0000","last_fullsized":"2024-09-12T21:57:10.086067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:10.085947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:10.085947+0000","last_clean_scrub_stamp":"2024-09-12T21:57:10.085947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:41.775637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.222133+0000","last_change":"2024-09-12T21:57:03.222156+0000","last_active":"2024-09-12T21:57:03.222133+0000","last_peered":"2024-09-12T21:57:03.222133+0000","last_clean":"2024-09-12T21:57:03.222133+0000","last_became_active":"2024-09-12T21:56:33.320043+0000","last_became_peered":"2024-09-12T21:56:33.320043+0000","last_unstale":"2024-09-12T21:57:03.222133+0000","last_undegraded":"2024-09-12T21:57:03.222133+0000","last_fullsized":"2024-09-12T21:57:03.222133+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:03.222022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:03.222022+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.222022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:05.835749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:58.567115+0000","last_change":"2024-09-12T21:56:58.567142+0000","last_active":"2024-09-12T21:56:58.567115+0000","last_peered":"2024-09-12T21:56:58.567115+0000","last_clean":"2024-09-12T21:56:58.567115+0000","last_became_active":"2024-09-12T21:56:33.320466+0000","last_became_peered":"2024-09-12T21:56:33.320466+0000","last_unstale":"2024-09-12T21:56:58.567115+0000","last_undegraded":"2024-09-12T21:56:58.567115+0000","last_fullsized":"2024-09-12T21:56:58.567115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:58.567027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:58.567027+0000","last_clean_scrub_stamp":"2024-09-12T21:56:58.567027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:37.899762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:05.164214+0000","last_change":"2024-09-12T21:57:05.164239+0000","last_active":"2024-09-12T21:57:05.164214+0000","last_peered":"2024-09-12T21:57:05.164214+0000","last_clean":"2024-09-12T21:57:05.164214+0000","last_became_active":"2024-09-12T21:56:33.320147+0000","last_became_peered":"2024-09-12T21:56:33.320147+0000","last_unstale":"2024-09-12T21:57:05.164214+0000","last_undegraded":"2024-09-12T21:57:05.164214+0000","last_fullsized":"2024-09-12T21:57:05.164214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:05.164127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:05.164127+0000","last_clean_scrub_stamp":"2024-09-12T21:57:05.164127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:51:45.701409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:14.642479+0000","last_change":"2024-09-12T21:57:14.642500+0000","last_active":"2024-09-12T21:57:14.642479+0000","last_peered":"2024-09-12T21:57:14.642479+0000","last_clean":"2024-09-12T21:57:14.642479+0000","last_became_active":"2024-09-12T21:56:33.322000+0000","last_became_peered":"2024-09-12T21:56:33.322000+0000","last_unstale":"2024-09-12T21:57:14.642479+0000","last_undegraded":"2024-09-12T21:57:14.642479+0000","last_fullsized":"2024-09-12T21:57:14.642479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:14.642360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:14.642360+0000","last_clean_scrub_stamp":"2024-09-12T21:57:14.642360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:45.188341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"87'12","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:13.759207+0000","last_change":"2024-09-12T21:57:13.759242+0000","last_active":"2024-09-12T21:57:13.759207+0000","last_peered":"2024-09-12T21:57:13.759207+0000","last_clean":"2024-09-12T21:57:13.759207+0000","last_became_active":"2024-09-12T21:56:33.318808+0000","last_became_peered":"2024-09-12T21:56:33.318808+0000","last_unstale":"2024-09-12T21:57:13.759207+0000","last_undegraded":"2024-09-12T21:57:13.759207+0000","last_fullsized":"2024-09-12T21:57:13.759207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'12","last_scrub_stamp":"2024-09-12T21:57:13.759109+0000","last_deep_scrub":"87'12","last_deep_scrub_stamp":"2024-09-12T21:57:13.759109+0000","last_clean_scrub_stamp":"2024-09-12T21:57:13.759109+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.707577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'2","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:04.891084+0000","last_change":"2024-09-12T21:57:04.891112+0000","last_active":"2024-09-12T21:57:04.891084+0000","last_peered":"2024-09-12T21:57:04.891084+0000","last_clean":"2024-09-12T21:57:04.891084+0000","last_became_active":"2024-09-12T21:56:33.323666+0000","last_became_peered":"2024-09-12T21:56:33.323666+0000","last_unstale":"2024-09-12T21:57:04.891084+0000","last_undegraded":"2024-09-12T21:57:04.891084+0000","last_fullsized":"2024-09-12T21:57:04.891084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:57:04.891001+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:57:04.891001+0000","last_clean_scrub_stamp":"2024-09-12T21:57:04.891001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:07.208337+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:19.915194+0000","last_change":"2024-09-12T21:57:19.915259+0000","last_active":"2024-09-12T21:57:19.915194+0000","last_peered":"2024-09-12T21:57:19.915194+0000","last_clean":"2024-09-12T21:57:19.915194+0000","last_became_active":"2024-09-12T21:56:33.328196+0000","last_became_peered":"2024-09-12T21:56:33.328196+0000","last_unstale":"2024-09-12T21:57:19.915194+0000","last_undegraded":"2024-09-12T21:57:19.915194+0000","last_fullsized":"2024-09-12T21:57:19.915194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:19.915098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:19.915098+0000","last_clean_scrub_stamp":"2024-09-12T21:57:19.915098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:07.747244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"87'3","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.143977+0000","last_change":"2024-09-12T21:57:01.144033+0000","last_active":"2024-09-12T21:57:01.143977+0000","last_peered":"2024-09-12T21:57:01.143977+0000","last_clean":"2024-09-12T21:57:01.143977+0000","last_became_active":"2024-09-12T21:56:33.319998+0000","last_became_peered":"2024-09-12T21:56:33.319998+0000","last_unstale":"2024-09-12T21:57:01.143977+0000","last_undegraded":"2024-09-12T21:57:01.143977+0000","last_fullsized":"2024-09-12T21:57:01.143977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:01.143864+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:01.143864+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.143864+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:02.873101+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:09.125159+0000","last_change":"2024-09-12T21:57:09.125199+0000","last_active":"2024-09-12T21:57:09.125159+0000","last_peered":"2024-09-12T21:57:09.125159+0000","last_clean":"2024-09-12T21:57:09.125159+0000","last_became_active":"2024-09-12T21:53:58.006759+0000","last_became_peered":"2024-09-12T21:53:58.006759+0000","last_unstale":"2024-09-12T21:57:09.125159+0000","last_undegraded":"2024-09-12T21:57:09.125159+0000","last_fullsized":"2024-09-12T21:57:09.125159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:09.125010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:09.125010+0000","last_clean_scrub_stamp":"2024-09-12T21:57:09.125010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.257231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'2","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.703298+0000","last_change":"2024-09-12T21:56:51.703329+0000","last_active":"2024-09-12T21:56:51.703298+0000","last_peered":"2024-09-12T21:56:51.703298+0000","last_clean":"2024-09-12T21:56:51.703298+0000","last_became_active":"2024-09-12T21:56:33.324767+0000","last_became_peered":"2024-09-12T21:56:33.324767+0000","last_unstale":"2024-09-12T21:56:51.703298+0000","last_undegraded":"2024-09-12T21:56:51.703298+0000","last_fullsized":"2024-09-12T21:56:51.703298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:56:51.703205+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:56:51.703205+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.703205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:02.457889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.830375+0000","last_change":"2024-09-12T21:56:48.830400+0000","last_active":"2024-09-12T21:56:48.830375+0000","last_peered":"2024-09-12T21:56:48.830375+0000","last_clean":"2024-09-12T21:56:48.830375+0000","last_became_active":"2024-09-12T21:56:33.323639+0000","last_became_peered":"2024-09-12T21:56:33.323639+0000","last_unstale":"2024-09-12T21:56:48.830375+0000","last_undegraded":"2024-09-12T21:56:48.830375+0000","last_fullsized":"2024-09-12T21:56:48.830375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:48.830236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:48.830236+0000","last_clean_scrub_stamp":"2024-09-12T21:56:48.830236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:25.577528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.083411+0000","last_change":"2024-09-12T21:56:53.083466+0000","last_active":"2024-09-12T21:56:53.083411+0000","last_peered":"2024-09-12T21:56:53.083411+0000","last_clean":"2024-09-12T21:56:53.083411+0000","last_became_active":"2024-09-12T21:53:59.012965+0000","last_became_peered":"2024-09-12T21:53:59.012965+0000","last_unstale":"2024-09-12T21:56:53.083411+0000","last_undegraded":"2024-09-12T21:56:53.083411+0000","last_fullsized":"2024-09-12T21:56:53.083411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.083315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.083315+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.083315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:17.932387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:18.638010+0000","last_change":"2024-09-12T21:57:18.638010+0000","last_active":"2024-09-12T21:57:18.638010+0000","last_peered":"2024-09-12T21:57:18.638010+0000","last_clean":"2024-09-12T21:57:18.638010+0000","last_became_active":"2024-09-12T21:56:33.327120+0000","last_became_peered":"2024-09-12T21:56:33.327120+0000","last_unstale":"2024-09-12T21:57:18.638010+0000","last_undegraded":"2024-09-12T21:57:18.638010+0000","last_fullsized":"2024-09-12T21:57:18.638010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:18.637884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:18.637884+0000","last_clean_scrub_stamp":"2024-09-12T21:57:18.637884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:25.280446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"87'3","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:19.599113+0000","last_change":"2024-09-12T21:57:19.599113+0000","last_active":"2024-09-12T21:57:19.599113+0000","last_peered":"2024-09-12T21:57:19.599113+0000","last_clean":"2024-09-12T21:57:19.599113+0000","last_became_active":"2024-09-12T21:56:33.327241+0000","last_became_peered":"2024-09-12T21:56:33.327241+0000","last_unstale":"2024-09-12T21:57:19.599113+0000","last_undegraded":"2024-09-12T21:57:19.599113+0000","last_fullsized":"2024-09-12T21:57:19.599113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:19.599001+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:19.599001+0000","last_clean_scrub_stamp":"2024-09-12T21:57:19.599001+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:20.097647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.806652+0000","last_change":"2024-09-12T21:56:59.806675+0000","last_active":"2024-09-12T21:56:59.806652+0000","last_peered":"2024-09-12T21:56:59.806652+0000","last_clean":"2024-09-12T21:56:59.806652+0000","last_became_active":"2024-09-12T21:56:33.320879+0000","last_became_peered":"2024-09-12T21:56:33.320879+0000","last_unstale":"2024-09-12T21:56:59.806652+0000","last_undegraded":"2024-09-12T21:56:59.806652+0000","last_fullsized":"2024-09-12T21:56:59.806652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.806556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.806556+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.806556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:21.521164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.744527+0000","last_change":"2024-09-12T21:56:57.744570+0000","last_active":"2024-09-12T21:56:57.744527+0000","last_peered":"2024-09-12T21:56:57.744527+0000","last_clean":"2024-09-12T21:56:57.744527+0000","last_became_active":"2024-09-12T21:56:33.319508+0000","last_became_peered":"2024-09-12T21:56:33.319508+0000","last_unstale":"2024-09-12T21:56:57.744527+0000","last_undegraded":"2024-09-12T21:56:57.744527+0000","last_fullsized":"2024-09-12T21:56:57.744527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.744429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.744429+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.744429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:47.538942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:47.809582+0000","last_change":"2024-09-12T21:56:47.809603+0000","last_active":"2024-09-12T21:56:47.809582+0000","last_peered":"2024-09-12T21:56:47.809582+0000","last_clean":"2024-09-12T21:56:47.809582+0000","last_became_active":"2024-09-12T21:56:33.324408+0000","last_became_peered":"2024-09-12T21:56:33.324408+0000","last_unstale":"2024-09-12T21:56:47.809582+0000","last_undegraded":"2024-09-12T21:56:47.809582+0000","last_fullsized":"2024-09-12T21:56:47.809582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:47.809497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:47.809497+0000","last_clean_scrub_stamp":"2024-09-12T21:56:47.809497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:24.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.105099+0000","last_change":"2024-09-12T21:56:57.105124+0000","last_active":"2024-09-12T21:56:57.105099+0000","last_peered":"2024-09-12T21:56:57.105099+0000","last_clean":"2024-09-12T21:56:57.105099+0000","last_became_active":"2024-09-12T21:56:33.319557+0000","last_became_peered":"2024-09-12T21:56:33.319557+0000","last_unstale":"2024-09-12T21:56:57.105099+0000","last_undegraded":"2024-09-12T21:56:57.105099+0000","last_fullsized":"2024-09-12T21:56:57.105099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.105002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.105002+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.105002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:40.357163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.723852+0000","last_change":"2024-09-12T21:56:53.723876+0000","last_active":"2024-09-12T21:56:53.723852+0000","last_peered":"2024-09-12T21:56:53.723852+0000","last_clean":"2024-09-12T21:56:53.723852+0000","last_became_active":"2024-09-12T21:56:33.322411+0000","last_became_peered":"2024-09-12T21:56:33.322411+0000","last_unstale":"2024-09-12T21:56:53.723852+0000","last_undegraded":"2024-09-12T21:56:53.723852+0000","last_fullsized":"2024-09-12T21:56:53.723852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.723765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.723765+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.723765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:22.965538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:04.182456+0000","last_change":"2024-09-12T21:57:04.182494+0000","last_active":"2024-09-12T21:57:04.182456+0000","last_peered":"2024-09-12T21:57:04.182456+0000","last_clean":"2024-09-12T21:57:04.182456+0000","last_became_active":"2024-09-12T21:53:58.008019+0000","last_became_peered":"2024-09-12T21:53:58.008019+0000","last_unstale":"2024-09-12T21:57:04.182456+0000","last_undegraded":"2024-09-12T21:57:04.182456+0000","last_fullsized":"2024-09-12T21:57:04.182456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:04.182370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:04.182370+0000","last_clean_scrub_stamp":"2024-09-12T21:57:04.182370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:28.707599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:59.600671+0000","last_change":"2024-09-12T21:56:59.600671+0000","last_active":"2024-09-12T21:56:59.600671+0000","last_peered":"2024-09-12T21:56:59.600671+0000","last_clean":"2024-09-12T21:56:59.600671+0000","last_became_active":"2024-09-12T21:53:58.008511+0000","last_became_peered":"2024-09-12T21:53:58.008511+0000","last_unstale":"2024-09-12T21:56:59.600671+0000","last_undegraded":"2024-09-12T21:56:59.600671+0000","last_fullsized":"2024-09-12T21:56:59.600671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:59.600525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:59.600525+0000","last_clean_scrub_stamp":"2024-09-12T21:56:59.600525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:04.283150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"87'159","reported_seq":373,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:08.813940+0000","last_change":"2024-09-12T21:57:08.814009+0000","last_active":"2024-09-12T21:57:08.813940+0000","last_peered":"2024-09-12T21:57:08.813940+0000","last_clean":"2024-09-12T21:57:08.813940+0000","last_became_active":"2024-09-12T21:56:33.317797+0000","last_became_peered":"2024-09-12T21:56:33.317797+0000","last_unstale":"2024-09-12T21:57:08.813940+0000","last_undegraded":"2024-09-12T21:57:08.813940+0000","last_fullsized":"2024-09-12T21:57:08.813940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'159","last_scrub_stamp":"2024-09-12T21:57:08.813825+0000","last_deep_scrub":"87'159","last_deep_scrub_stamp":"2024-09-12T21:57:08.813825+0000","last_clean_scrub_stamp":"2024-09-12T21:57:08.813825+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:39.188256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"87'2","reported_seq":183,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:19.713102+0000","last_change":"2024-09-12T21:57:19.713130+0000","last_active":"2024-09-12T21:57:19.713102+0000","last_peered":"2024-09-12T21:57:19.713102+0000","last_clean":"2024-09-12T21:57:19.713102+0000","last_became_active":"2024-09-12T21:56:33.327240+0000","last_became_peered":"2024-09-12T21:56:33.327240+0000","last_unstale":"2024-09-12T21:57:19.713102+0000","last_undegraded":"2024-09-12T21:57:19.713102+0000","last_fullsized":"2024-09-12T21:57:19.713102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:57:19.713014+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:57:19.713014+0000","last_clean_scrub_stamp":"2024-09-12T21:57:19.713014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:54.868059+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058885199999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":169,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:01.629917+0000","last_change":"2024-09-12T21:57:01.629956+0000","last_active":"2024-09-12T21:57:01.629917+0000","last_peered":"2024-09-12T21:57:01.629917+0000","last_clean":"2024-09-12T21:57:01.629917+0000","last_became_active":"2024-09-12T21:53:58.008708+0000","last_became_peered":"2024-09-12T21:53:58.008708+0000","last_unstale":"2024-09-12T21:57:01.629917+0000","last_undegraded":"2024-09-12T21:57:01.629917+0000","last_fullsized":"2024-09-12T21:57:01.629917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:01.629769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:01.629769+0000","last_clean_scrub_stamp":"2024-09-12T21:57:01.629769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:28.390680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:20.741095+0000","last_change":"2024-09-12T21:57:20.741123+0000","last_active":"2024-09-12T21:57:20.741095+0000","last_peered":"2024-09-12T21:57:20.741095+0000","last_clean":"2024-09-12T21:57:20.741095+0000","last_became_active":"2024-09-12T21:56:33.326691+0000","last_became_peered":"2024-09-12T21:56:33.326691+0000","last_unstale":"2024-09-12T21:57:20.741095+0000","last_undegraded":"2024-09-12T21:57:20.741095+0000","last_fullsized":"2024-09-12T21:57:20.741095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:20.741000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:20.741000+0000","last_clean_scrub_stamp":"2024-09-12T21:57:20.741000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:13.912250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.791101+0000","last_change":"2024-09-12T21:56:49.791140+0000","last_active":"2024-09-12T21:56:49.791101+0000","last_peered":"2024-09-12T21:56:49.791101+0000","last_clean":"2024-09-12T21:56:49.791101+0000","last_became_active":"2024-09-12T21:56:33.325318+0000","last_became_peered":"2024-09-12T21:56:33.325318+0000","last_unstale":"2024-09-12T21:56:49.791101+0000","last_undegraded":"2024-09-12T21:56:49.791101+0000","last_fullsized":"2024-09-12T21:56:49.791101+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:49.791008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:49.791008+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.791008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:19.212447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000374101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:52.685177+0000","last_change":"2024-09-12T21:56:52.685177+0000","last_active":"2024-09-12T21:56:52.685177+0000","last_peered":"2024-09-12T21:56:52.685177+0000","last_clean":"2024-09-12T21:56:52.685177+0000","last_became_active":"2024-09-12T21:53:59.014202+0000","last_became_peered":"2024-09-12T21:53:59.014202+0000","last_unstale":"2024-09-12T21:56:52.685177+0000","last_undegraded":"2024-09-12T21:56:52.685177+0000","last_fullsized":"2024-09-12T21:56:52.685177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:52.685066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:52.685066+0000","last_clean_scrub_stamp":"2024-09-12T21:56:52.685066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:18.354993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.104724+0000","last_change":"2024-09-12T21:56:56.104751+0000","last_active":"2024-09-12T21:56:56.104724+0000","last_peered":"2024-09-12T21:56:56.104724+0000","last_clean":"2024-09-12T21:56:56.104724+0000","last_became_active":"2024-09-12T21:53:58.008138+0000","last_became_peered":"2024-09-12T21:53:58.008138+0000","last_unstale":"2024-09-12T21:56:56.104724+0000","last_undegraded":"2024-09-12T21:56:56.104724+0000","last_fullsized":"2024-09-12T21:56:56.104724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.104628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.104628+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.104628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.216230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:07.617720+0000","last_change":"2024-09-12T21:57:07.617761+0000","last_active":"2024-09-12T21:57:07.617720+0000","last_peered":"2024-09-12T21:57:07.617720+0000","last_clean":"2024-09-12T21:57:07.617720+0000","last_became_active":"2024-09-12T21:53:58.008219+0000","last_became_peered":"2024-09-12T21:53:58.008219+0000","last_unstale":"2024-09-12T21:57:07.617720+0000","last_undegraded":"2024-09-12T21:57:07.617720+0000","last_fullsized":"2024-09-12T21:57:07.617720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:07.617624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:07.617624+0000","last_clean_scrub_stamp":"2024-09-12T21:57:07.617624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:41.729569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030731299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:18.940667+0000","last_change":"2024-09-12T21:57:18.940707+0000","last_active":"2024-09-12T21:57:18.940667+0000","last_peered":"2024-09-12T21:57:18.940667+0000","last_clean":"2024-09-12T21:57:18.940667+0000","last_became_active":"2024-09-12T21:56:33.322362+0000","last_became_peered":"2024-09-12T21:56:33.322362+0000","last_unstale":"2024-09-12T21:57:18.940667+0000","last_undegraded":"2024-09-12T21:57:18.940667+0000","last_fullsized":"2024-09-12T21:57:18.940667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:18.940569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:18.940569+0000","last_clean_scrub_stamp":"2024-09-12T21:57:18.940569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:29.974736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:57.581177+0000","last_change":"2024-09-12T21:56:57.581177+0000","last_active":"2024-09-12T21:56:57.581177+0000","last_peered":"2024-09-12T21:56:57.581177+0000","last_clean":"2024-09-12T21:56:57.581177+0000","last_became_active":"2024-09-12T21:53:58.009394+0000","last_became_peered":"2024-09-12T21:53:58.009394+0000","last_unstale":"2024-09-12T21:56:57.581177+0000","last_undegraded":"2024-09-12T21:56:57.581177+0000","last_fullsized":"2024-09-12T21:56:57.581177+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:57.581028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:57.581028+0000","last_clean_scrub_stamp":"2024-09-12T21:56:57.581028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:56.283699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"87'3","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:03.893758+0000","last_change":"2024-09-12T21:57:03.893791+0000","last_active":"2024-09-12T21:57:03.893758+0000","last_peered":"2024-09-12T21:57:03.893758+0000","last_clean":"2024-09-12T21:57:03.893758+0000","last_became_active":"2024-09-12T21:56:33.319141+0000","last_became_peered":"2024-09-12T21:56:33.319141+0000","last_unstale":"2024-09-12T21:57:03.893758+0000","last_undegraded":"2024-09-12T21:57:03.893758+0000","last_fullsized":"2024-09-12T21:57:03.893758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:03.893666+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:03.893666+0000","last_clean_scrub_stamp":"2024-09-12T21:57:03.893666+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:22.752348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061933400000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.786374+0000","last_change":"2024-09-12T21:56:56.786397+0000","last_active":"2024-09-12T21:56:56.786374+0000","last_peered":"2024-09-12T21:56:56.786374+0000","last_clean":"2024-09-12T21:56:56.786374+0000","last_became_active":"2024-09-12T21:56:33.321342+0000","last_became_peered":"2024-09-12T21:56:33.321342+0000","last_unstale":"2024-09-12T21:56:56.786374+0000","last_undegraded":"2024-09-12T21:56:56.786374+0000","last_fullsized":"2024-09-12T21:56:56.786374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.786244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.786244+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.786244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:24.933436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:08.576084+0000","last_change":"2024-09-12T21:57:08.576141+0000","last_active":"2024-09-12T21:57:08.576084+0000","last_peered":"2024-09-12T21:57:08.576084+0000","last_clean":"2024-09-12T21:57:08.576084+0000","last_became_active":"2024-09-12T21:53:58.008480+0000","last_became_peered":"2024-09-12T21:53:58.008480+0000","last_unstale":"2024-09-12T21:57:08.576084+0000","last_undegraded":"2024-09-12T21:57:08.576084+0000","last_fullsized":"2024-09-12T21:57:08.576084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:08.575971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:08.575971+0000","last_clean_scrub_stamp":"2024-09-12T21:57:08.575971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:21.352326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.842248+0000","last_change":"2024-09-12T21:57:00.842273+0000","last_active":"2024-09-12T21:57:00.842248+0000","last_peered":"2024-09-12T21:57:00.842248+0000","last_clean":"2024-09-12T21:57:00.842248+0000","last_became_active":"2024-09-12T21:56:33.323018+0000","last_became_peered":"2024-09-12T21:56:33.323018+0000","last_unstale":"2024-09-12T21:57:00.842248+0000","last_undegraded":"2024-09-12T21:57:00.842248+0000","last_fullsized":"2024-09-12T21:57:00.842248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.842162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.842162+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.842162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:17.013903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:53.643629+0000","last_change":"2024-09-12T21:56:53.643670+0000","last_active":"2024-09-12T21:56:53.643629+0000","last_peered":"2024-09-12T21:56:53.643629+0000","last_clean":"2024-09-12T21:56:53.643629+0000","last_became_active":"2024-09-12T21:53:58.010907+0000","last_became_peered":"2024-09-12T21:53:58.010907+0000","last_unstale":"2024-09-12T21:56:53.643629+0000","last_undegraded":"2024-09-12T21:56:53.643629+0000","last_fullsized":"2024-09-12T21:56:53.643629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:53.643531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:53.643531+0000","last_clean_scrub_stamp":"2024-09-12T21:56:53.643531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:12.117896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031153399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.026557+0000","last_change":"2024-09-12T21:56:50.026617+0000","last_active":"2024-09-12T21:56:50.026557+0000","last_peered":"2024-09-12T21:56:50.026557+0000","last_clean":"2024-09-12T21:56:50.026557+0000","last_became_active":"2024-09-12T21:56:33.320552+0000","last_became_peered":"2024-09-12T21:56:33.320552+0000","last_unstale":"2024-09-12T21:56:50.026557+0000","last_undegraded":"2024-09-12T21:56:50.026557+0000","last_fullsized":"2024-09-12T21:56:50.026557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.026460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.026460+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.026460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:23.445265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":169,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.641373+0000","last_change":"2024-09-12T21:56:55.641409+0000","last_active":"2024-09-12T21:56:55.641373+0000","last_peered":"2024-09-12T21:56:55.641373+0000","last_clean":"2024-09-12T21:56:55.641373+0000","last_became_active":"2024-09-12T21:53:58.010661+0000","last_became_peered":"2024-09-12T21:53:58.010661+0000","last_unstale":"2024-09-12T21:56:55.641373+0000","last_undegraded":"2024-09-12T21:56:55.641373+0000","last_fullsized":"2024-09-12T21:56:55.641373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:55.641227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:55.641227+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.641227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:25:53.458440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:15.890347+0000","last_change":"2024-09-12T21:57:15.890371+0000","last_active":"2024-09-12T21:57:15.890347+0000","last_peered":"2024-09-12T21:57:15.890347+0000","last_clean":"2024-09-12T21:57:15.890347+0000","last_became_active":"2024-09-12T21:53:58.007390+0000","last_became_peered":"2024-09-12T21:53:58.007390+0000","last_unstale":"2024-09-12T21:57:15.890347+0000","last_undegraded":"2024-09-12T21:57:15.890347+0000","last_fullsized":"2024-09-12T21:57:15.890347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:15.890261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:15.890261+0000","last_clean_scrub_stamp":"2024-09-12T21:57:15.890261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:13.024919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:16.889053+0000","last_change":"2024-09-12T21:57:16.889091+0000","last_active":"2024-09-12T21:57:16.889053+0000","last_peered":"2024-09-12T21:57:16.889053+0000","last_clean":"2024-09-12T21:57:16.889053+0000","last_became_active":"2024-09-12T21:56:33.320487+0000","last_became_peered":"2024-09-12T21:56:33.320487+0000","last_unstale":"2024-09-12T21:57:16.889053+0000","last_undegraded":"2024-09-12T21:57:16.889053+0000","last_fullsized":"2024-09-12T21:57:16.889053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:16.888959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:16.888959+0000","last_clean_scrub_stamp":"2024-09-12T21:57:16.888959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:32.432193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'3","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:49.727586+0000","last_change":"2024-09-12T21:56:49.727586+0000","last_active":"2024-09-12T21:56:49.727586+0000","last_peered":"2024-09-12T21:56:49.727586+0000","last_clean":"2024-09-12T21:56:49.727586+0000","last_became_active":"2024-09-12T21:53:58.011248+0000","last_became_peered":"2024-09-12T21:53:58.011248+0000","last_unstale":"2024-09-12T21:56:49.727586+0000","last_undegraded":"2024-09-12T21:56:49.727586+0000","last_fullsized":"2024-09-12T21:56:49.727586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:56:49.727428+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:56:49.727428+0000","last_clean_scrub_stamp":"2024-09-12T21:56:49.727428+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:02.863846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.732399+0000","last_change":"2024-09-12T21:56:50.732399+0000","last_active":"2024-09-12T21:56:50.732399+0000","last_peered":"2024-09-12T21:56:50.732399+0000","last_clean":"2024-09-12T21:56:50.732399+0000","last_became_active":"2024-09-12T21:53:58.011869+0000","last_became_peered":"2024-09-12T21:53:58.011869+0000","last_unstale":"2024-09-12T21:56:50.732399+0000","last_undegraded":"2024-09-12T21:56:50.732399+0000","last_fullsized":"2024-09-12T21:56:50.732399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.732234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.732234+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.732234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.759810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049408600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:17.660839+0000","last_change":"2024-09-12T21:57:17.660899+0000","last_active":"2024-09-12T21:57:17.660839+0000","last_peered":"2024-09-12T21:57:17.660839+0000","last_clean":"2024-09-12T21:57:17.660839+0000","last_became_active":"2024-09-12T21:56:33.326389+0000","last_became_peered":"2024-09-12T21:56:33.326389+0000","last_unstale":"2024-09-12T21:57:17.660839+0000","last_undegraded":"2024-09-12T21:57:17.660839+0000","last_fullsized":"2024-09-12T21:57:17.660839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:17.660700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:17.660700+0000","last_clean_scrub_stamp":"2024-09-12T21:57:17.660700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:44.450279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"87'2","reported_seq":176,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.674960+0000","last_change":"2024-09-12T21:56:54.674960+0000","last_active":"2024-09-12T21:56:54.674960+0000","last_peered":"2024-09-12T21:56:54.674960+0000","last_clean":"2024-09-12T21:56:54.674960+0000","last_became_active":"2024-09-12T21:53:59.014266+0000","last_became_peered":"2024-09-12T21:53:59.014266+0000","last_unstale":"2024-09-12T21:56:54.674960+0000","last_undegraded":"2024-09-12T21:56:54.674960+0000","last_fullsized":"2024-09-12T21:56:54.674960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-09-12T21:56:54.674791+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-09-12T21:56:54.674791+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.674791+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.446282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:05.845984+0000","last_change":"2024-09-12T21:57:05.846013+0000","last_active":"2024-09-12T21:57:05.845984+0000","last_peered":"2024-09-12T21:57:05.845984+0000","last_clean":"2024-09-12T21:57:05.845984+0000","last_became_active":"2024-09-12T21:56:33.320053+0000","last_became_peered":"2024-09-12T21:56:33.320053+0000","last_unstale":"2024-09-12T21:57:05.845984+0000","last_undegraded":"2024-09-12T21:57:05.845984+0000","last_fullsized":"2024-09-12T21:57:05.845984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:05.845893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:05.845893+0000","last_clean_scrub_stamp":"2024-09-12T21:57:05.845893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:12.751639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372872,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:51.014342+0000","last_change":"2024-09-12T21:56:51.014365+0000","last_active":"2024-09-12T21:56:51.014342+0000","last_peered":"2024-09-12T21:56:51.014342+0000","last_clean":"2024-09-12T21:56:51.014342+0000","last_became_active":"2024-09-12T21:56:33.321554+0000","last_became_peered":"2024-09-12T21:56:33.321554+0000","last_unstale":"2024-09-12T21:56:51.014342+0000","last_undegraded":"2024-09-12T21:56:51.014342+0000","last_fullsized":"2024-09-12T21:56:51.014342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:51.014257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:51.014257+0000","last_clean_scrub_stamp":"2024-09-12T21:56:51.014257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:40.812665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:50.745177+0000","last_change":"2024-09-12T21:56:50.745200+0000","last_active":"2024-09-12T21:56:50.745177+0000","last_peered":"2024-09-12T21:56:50.745177+0000","last_clean":"2024-09-12T21:56:50.745177+0000","last_became_active":"2024-09-12T21:56:33.324928+0000","last_became_peered":"2024-09-12T21:56:33.324928+0000","last_unstale":"2024-09-12T21:56:50.745177+0000","last_undegraded":"2024-09-12T21:56:50.745177+0000","last_fullsized":"2024-09-12T21:56:50.745177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:50.745086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:50.745086+0000","last_clean_scrub_stamp":"2024-09-12T21:56:50.745086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:57.670416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"87'10","reported_seq":171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:10.751483+0000","last_change":"2024-09-12T21:57:10.751514+0000","last_active":"2024-09-12T21:57:10.751483+0000","last_peered":"2024-09-12T21:57:10.751483+0000","last_clean":"2024-09-12T21:57:10.751483+0000","last_became_active":"2024-09-12T21:56:33.318809+0000","last_became_peered":"2024-09-12T21:56:33.318809+0000","last_unstale":"2024-09-12T21:57:10.751483+0000","last_undegraded":"2024-09-12T21:57:10.751483+0000","last_fullsized":"2024-09-12T21:57:10.751483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'10","last_scrub_stamp":"2024-09-12T21:57:10.751398+0000","last_deep_scrub":"87'10","last_deep_scrub_stamp":"2024-09-12T21:57:10.751398+0000","last_clean_scrub_stamp":"2024-09-12T21:57:10.751398+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:34.936503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:11.572102+0000","last_change":"2024-09-12T21:57:11.572124+0000","last_active":"2024-09-12T21:57:11.572102+0000","last_peered":"2024-09-12T21:57:11.572102+0000","last_clean":"2024-09-12T21:57:11.572102+0000","last_became_active":"2024-09-12T21:53:58.008160+0000","last_became_peered":"2024-09-12T21:53:58.008160+0000","last_unstale":"2024-09-12T21:57:11.572102+0000","last_undegraded":"2024-09-12T21:57:11.572102+0000","last_fullsized":"2024-09-12T21:57:11.572102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:11.572014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:11.572014+0000","last_clean_scrub_stamp":"2024-09-12T21:57:11.572014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:39.456915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"87'5","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:22.942835+0000","last_change":"2024-09-12T21:57:22.942867+0000","last_active":"2024-09-12T21:57:22.942835+0000","last_peered":"2024-09-12T21:57:22.942835+0000","last_clean":"2024-09-12T21:57:22.942835+0000","last_became_active":"2024-09-12T21:56:33.328780+0000","last_became_peered":"2024-09-12T21:56:33.328780+0000","last_unstale":"2024-09-12T21:57:22.942835+0000","last_undegraded":"2024-09-12T21:57:22.942835+0000","last_fullsized":"2024-09-12T21:57:22.942835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'5","last_scrub_stamp":"2024-09-12T21:57:22.942737+0000","last_deep_scrub":"87'5","last_deep_scrub_stamp":"2024-09-12T21:57:22.942737+0000","last_clean_scrub_stamp":"2024-09-12T21:57:22.942737+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:20.666872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:11.719522+0000","last_change":"2024-09-12T21:57:11.719551+0000","last_active":"2024-09-12T21:57:11.719522+0000","last_peered":"2024-09-12T21:57:11.719522+0000","last_clean":"2024-09-12T21:57:11.719522+0000","last_became_active":"2024-09-12T21:56:33.319340+0000","last_became_peered":"2024-09-12T21:56:33.319340+0000","last_unstale":"2024-09-12T21:57:11.719522+0000","last_undegraded":"2024-09-12T21:57:11.719522+0000","last_fullsized":"2024-09-12T21:57:11.719522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:11.719426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:11.719426+0000","last_clean_scrub_stamp":"2024-09-12T21:57:11.719426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:19.562269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:56.619023+0000","last_change":"2024-09-12T21:56:56.619081+0000","last_active":"2024-09-12T21:56:56.619023+0000","last_peered":"2024-09-12T21:56:56.619023+0000","last_clean":"2024-09-12T21:56:56.619023+0000","last_became_active":"2024-09-12T21:56:33.320352+0000","last_became_peered":"2024-09-12T21:56:33.320352+0000","last_unstale":"2024-09-12T21:56:56.619023+0000","last_undegraded":"2024-09-12T21:56:56.619023+0000","last_fullsized":"2024-09-12T21:56:56.619023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:56.618924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:56.618924+0000","last_clean_scrub_stamp":"2024-09-12T21:56:56.618924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:25.987060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:16.613753+0000","last_change":"2024-09-12T21:57:16.613807+0000","last_active":"2024-09-12T21:57:16.613753+0000","last_peered":"2024-09-12T21:57:16.613753+0000","last_clean":"2024-09-12T21:57:16.613753+0000","last_became_active":"2024-09-12T21:56:33.322778+0000","last_became_peered":"2024-09-12T21:56:33.322778+0000","last_unstale":"2024-09-12T21:57:16.613753+0000","last_undegraded":"2024-09-12T21:57:16.613753+0000","last_fullsized":"2024-09-12T21:57:16.613753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:16.613645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:16.613645+0000","last_clean_scrub_stamp":"2024-09-12T21:57:16.613645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:44.119433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":166,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:04.579565+0000","last_change":"2024-09-12T21:57:04.579599+0000","last_active":"2024-09-12T21:57:04.579565+0000","last_peered":"2024-09-12T21:57:04.579565+0000","last_clean":"2024-09-12T21:57:04.579565+0000","last_became_active":"2024-09-12T21:53:58.005477+0000","last_became_peered":"2024-09-12T21:53:58.005477+0000","last_unstale":"2024-09-12T21:57:04.579565+0000","last_undegraded":"2024-09-12T21:57:04.579565+0000","last_fullsized":"2024-09-12T21:57:04.579565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:04.579478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:04.579478+0000","last_clean_scrub_stamp":"2024-09-12T21:57:04.579478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:26.114038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:20.887945+0000","last_change":"2024-09-12T21:57:20.887995+0000","last_active":"2024-09-12T21:57:20.887945+0000","last_peered":"2024-09-12T21:57:20.887945+0000","last_clean":"2024-09-12T21:57:20.887945+0000","last_became_active":"2024-09-12T21:56:33.328174+0000","last_became_peered":"2024-09-12T21:56:33.328174+0000","last_unstale":"2024-09-12T21:57:20.887945+0000","last_undegraded":"2024-09-12T21:57:20.887945+0000","last_fullsized":"2024-09-12T21:57:20.887945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:20.887847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:20.887847+0000","last_clean_scrub_stamp":"2024-09-12T21:57:20.887847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:21.365384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:05.579983+0000","last_change":"2024-09-12T21:57:05.580009+0000","last_active":"2024-09-12T21:57:05.579983+0000","last_peered":"2024-09-12T21:57:05.579983+0000","last_clean":"2024-09-12T21:57:05.579983+0000","last_became_active":"2024-09-12T21:53:58.005561+0000","last_became_peered":"2024-09-12T21:53:58.005561+0000","last_unstale":"2024-09-12T21:57:05.579983+0000","last_undegraded":"2024-09-12T21:57:05.579983+0000","last_fullsized":"2024-09-12T21:57:05.579983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:05.579899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:05.579899+0000","last_clean_scrub_stamp":"2024-09-12T21:57:05.579899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:21.308339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:02.621445+0000","last_change":"2024-09-12T21:57:02.621468+0000","last_active":"2024-09-12T21:57:02.621445+0000","last_peered":"2024-09-12T21:57:02.621445+0000","last_clean":"2024-09-12T21:57:02.621445+0000","last_became_active":"2024-09-12T21:56:33.320492+0000","last_became_peered":"2024-09-12T21:56:33.320492+0000","last_unstale":"2024-09-12T21:57:02.621445+0000","last_undegraded":"2024-09-12T21:57:02.621445+0000","last_fullsized":"2024-09-12T21:57:02.621445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:02.621324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:02.621324+0000","last_clean_scrub_stamp":"2024-09-12T21:57:02.621324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:31.580839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:00.604279+0000","last_change":"2024-09-12T21:57:00.604304+0000","last_active":"2024-09-12T21:57:00.604279+0000","last_peered":"2024-09-12T21:57:00.604279+0000","last_clean":"2024-09-12T21:57:00.604279+0000","last_became_active":"2024-09-12T21:56:33.320350+0000","last_became_peered":"2024-09-12T21:56:33.320350+0000","last_unstale":"2024-09-12T21:57:00.604279+0000","last_undegraded":"2024-09-12T21:57:00.604279+0000","last_fullsized":"2024-09-12T21:57:00.604279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:00.604194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:00.604194+0000","last_clean_scrub_stamp":"2024-09-12T21:57:00.604194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:00.231154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:23.991049+0000","last_change":"2024-09-12T21:57:23.991104+0000","last_active":"2024-09-12T21:57:23.991049+0000","last_peered":"2024-09-12T21:57:23.991049+0000","last_clean":"2024-09-12T21:57:23.991049+0000","last_became_active":"2024-09-12T21:56:33.329973+0000","last_became_peered":"2024-09-12T21:56:33.329973+0000","last_unstale":"2024-09-12T21:57:23.991049+0000","last_undegraded":"2024-09-12T21:57:23.991049+0000","last_fullsized":"2024-09-12T21:57:23.991049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:23.990956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:23.990956+0000","last_clean_scrub_stamp":"2024-09-12T21:57:23.990956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:07.918522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:12.998165+0000","last_change":"2024-09-12T21:57:12.998208+0000","last_active":"2024-09-12T21:57:12.998165+0000","last_peered":"2024-09-12T21:57:12.998165+0000","last_clean":"2024-09-12T21:57:12.998165+0000","last_became_active":"2024-09-12T21:53:58.007005+0000","last_became_peered":"2024-09-12T21:53:58.007005+0000","last_unstale":"2024-09-12T21:57:12.998165+0000","last_undegraded":"2024-09-12T21:57:12.998165+0000","last_fullsized":"2024-09-12T21:57:12.998165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T21:57:12.998035+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T21:57:12.998035+0000","last_clean_scrub_stamp":"2024-09-12T21:57:12.998035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:55.601885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:06.127031+0000","last_change":"2024-09-12T21:57:06.127055+0000","last_active":"2024-09-12T21:57:06.127031+0000","last_peered":"2024-09-12T21:57:06.127031+0000","last_clean":"2024-09-12T21:57:06.127031+0000","last_became_active":"2024-09-12T21:53:58.007775+0000","last_became_peered":"2024-09-12T21:53:58.007775+0000","last_unstale":"2024-09-12T21:57:06.127031+0000","last_undegraded":"2024-09-12T21:57:06.127031+0000","last_fullsized":"2024-09-12T21:57:06.127031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:06.126940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:06.126940+0000","last_clean_scrub_stamp":"2024-09-12T21:57:06.126940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.369715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.055622+0000","last_change":"2024-09-12T21:56:55.055647+0000","last_active":"2024-09-12T21:56:55.055622+0000","last_peered":"2024-09-12T21:56:55.055622+0000","last_clean":"2024-09-12T21:56:55.055622+0000","last_became_active":"2024-09-12T21:53:59.013427+0000","last_became_peered":"2024-09-12T21:53:59.013427+0000","last_unstale":"2024-09-12T21:56:55.055622+0000","last_undegraded":"2024-09-12T21:56:55.055622+0000","last_fullsized":"2024-09-12T21:56:55.055622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T21:56:55.055532+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T21:56:55.055532+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.055532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:25.198312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:16.719128+0000","last_change":"2024-09-12T21:57:16.719181+0000","last_active":"2024-09-12T21:57:16.719128+0000","last_peered":"2024-09-12T21:57:16.719128+0000","last_clean":"2024-09-12T21:57:16.719128+0000","last_became_active":"2024-09-12T21:56:33.322658+0000","last_became_peered":"2024-09-12T21:56:33.322658+0000","last_unstale":"2024-09-12T21:57:16.719128+0000","last_undegraded":"2024-09-12T21:57:16.719128+0000","last_fullsized":"2024-09-12T21:57:16.719128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:16.719019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:16.719019+0000","last_clean_scrub_stamp":"2024-09-12T21:57:16.719019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:53.208380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"87'3","reported_seq":129,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:12.764146+0000","last_change":"2024-09-12T21:57:12.764195+0000","last_active":"2024-09-12T21:57:12.764146+0000","last_peered":"2024-09-12T21:57:12.764146+0000","last_clean":"2024-09-12T21:57:12.764146+0000","last_became_active":"2024-09-12T21:56:33.319054+0000","last_became_peered":"2024-09-12T21:56:33.319054+0000","last_unstale":"2024-09-12T21:57:12.764146+0000","last_undegraded":"2024-09-12T21:57:12.764146+0000","last_fullsized":"2024-09-12T21:57:12.764146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:12.764015+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:12.764015+0000","last_clean_scrub_stamp":"2024-09-12T21:57:12.764015+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:30.815215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:54.690058+0000","last_change":"2024-09-12T21:56:54.690083+0000","last_active":"2024-09-12T21:56:54.690058+0000","last_peered":"2024-09-12T21:56:54.690058+0000","last_clean":"2024-09-12T21:56:54.690058+0000","last_became_active":"2024-09-12T21:56:33.320635+0000","last_became_peered":"2024-09-12T21:56:33.320635+0000","last_unstale":"2024-09-12T21:56:54.690058+0000","last_undegraded":"2024-09-12T21:56:54.690058+0000","last_fullsized":"2024-09-12T21:56:54.690058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:54.689960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:54.689960+0000","last_clean_scrub_stamp":"2024-09-12T21:56:54.689960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:42.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"87'3","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:21.930600+0000","last_change":"2024-09-12T21:57:21.930654+0000","last_active":"2024-09-12T21:57:21.930600+0000","last_peered":"2024-09-12T21:57:21.930600+0000","last_clean":"2024-09-12T21:57:21.930600+0000","last_became_active":"2024-09-12T21:56:33.328556+0000","last_became_peered":"2024-09-12T21:56:33.328556+0000","last_unstale":"2024-09-12T21:57:21.930600+0000","last_undegraded":"2024-09-12T21:57:21.930600+0000","last_fullsized":"2024-09-12T21:57:21.930600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'3","last_scrub_stamp":"2024-09-12T21:57:21.930500+0000","last_deep_scrub":"87'3","last_deep_scrub_stamp":"2024-09-12T21:57:21.930500+0000","last_clean_scrub_stamp":"2024-09-12T21:57:21.930500+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:54.578391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:08.112125+0000","last_change":"2024-09-12T21:57:08.112166+0000","last_active":"2024-09-12T21:57:08.112125+0000","last_peered":"2024-09-12T21:57:08.112125+0000","last_clean":"2024-09-12T21:57:08.112125+0000","last_became_active":"2024-09-12T21:53:58.006957+0000","last_became_peered":"2024-09-12T21:53:58.006957+0000","last_unstale":"2024-09-12T21:57:08.112125+0000","last_undegraded":"2024-09-12T21:57:08.112125+0000","last_fullsized":"2024-09-12T21:57:08.112125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:57:08.111984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:57:08.111984+0000","last_clean_scrub_stamp":"2024-09-12T21:57:08.111984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:15.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:48.721395+0000","last_change":"2024-09-12T21:56:48.721454+0000","last_active":"2024-09-12T21:56:48.721395+0000","last_peered":"2024-09-12T21:56:48.721395+0000","last_clean":"2024-09-12T21:56:48.721395+0000","last_became_active":"2024-09-12T21:53:58.011732+0000","last_became_peered":"2024-09-12T21:53:58.011732+0000","last_unstale":"2024-09-12T21:56:48.721395+0000","last_undegraded":"2024-09-12T21:56:48.721395+0000","last_fullsized":"2024-09-12T21:56:48.721395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T21:56:48.721288+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T21:56:48.721288+0000","last_clean_scrub_stamp":"2024-09-12T21:56:48.721288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:53.437016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:56:55.739559+0000","last_change":"2024-09-12T21:56:55.739586+0000","last_active":"2024-09-12T21:56:55.739559+0000","last_peered":"2024-09-12T21:56:55.739559+0000","last_clean":"2024-09-12T21:56:55.739559+0000","last_became_active":"2024-09-12T21:56:33.321287+0000","last_became_peered":"2024-09-12T21:56:33.321287+0000","last_unstale":"2024-09-12T21:56:55.739559+0000","last_undegraded":"2024-09-12T21:56:55.739559+0000","last_fullsized":"2024-09-12T21:56:55.739559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T21:56:55.739464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T21:56:55.739464+0000","last_clean_scrub_stamp":"2024-09-12T21:56:55.739464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:01.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-12T21:57:15.654797+0000","last_change":"2024-09-12T21:57:15.654826+0000","last_active":"2024-09-12T21:57:15.654797+0000","last_peered":"2024-09-12T21:57:15.654797+0000","last_clean":"2024-09-12T21:57:15.654797+0000","last_became_active":"2024-09-12T21:56:33.322657+0000","last_became_peered":"2024-09-12T21:56:33.322657+0000","last_unstale":"2024-09-12T21:57:15.654797+0000","last_undegraded":"2024-09-12T21:57:15.654797+0000","last_fullsized":"2024-09-12T21:57:15.654797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'6","last_scrub_stamp":"2024-09-12T21:57:15.654713+0000","last_deep_scrub":"87'6","last_deep_scrub_stamp":"2024-09-12T21:57:15.654713+0000","last_clean_scrub_stamp":"2024-09-12T21:57:15.654713+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:00.874685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9952,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":72,"seq":309237645356,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41084,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":39482,"kb_avail":94330756,"statfs":{"total":96636764160,"available":96594694144,"internally_reserved":0,"allocated":1617920,"data_stored":988972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6042,"internal_metadata":40429670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738455,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437548,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":436542,"kb_avail":93934292,"statfs":{"total":96636764160,"available":96188715008,"internally_reserved":0,"allocated":1011712,"data_stored":397445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":447019461},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383693,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62728,"kb_used_data":1592,"kb_used_omap":6,"kb_used_meta":61113,"kb_avail":94309112,"statfs":{"total":96636764160,"available":96572530688,"internally_reserved":0,"allocated":1630208,"data_stored":989607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7100,"internal_metadata":62579780},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5505,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T21:57:29.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T21:57:29.944 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T21:57:29.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:57:30.270 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:57:30.271 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:57:30.271 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:57:30.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T21:57:30.610 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:57:30.610 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-09-12T21:50:41:846705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T21:50:39.196391+0000","modified":"2024-09-12T21:50:41.193174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.53:6803/112708667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":112708667},{"type":"v1","addr":"172.21.15.53:6803","nonce":112708667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4233,"qdb_cluster":[4233]},"id":1}]} 2024-09-12T21:57:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-09-12T21:57:30.623 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T21:57:30.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-12T21:57:30.911 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":87,"fsid":"26a72ca2-5422-4f5a-b9d8-5b86b4cea2a6","created":"2024-09-12T21:50:18.608077+0000","modified":"2024-09-12T21:56:41.347803+0000","last_up_change":"2024-09-12T21:56:32.306559+0000","last_in_change":"2024-09-12T21:50:19.412280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T21:50:28.897797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T21:50:33.626302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T21:50:37.711817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T21:50:38.173173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d630dcc-ee37-4038-813b-4830ab592c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6801","nonce":908289176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6803","nonce":908289176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6807","nonce":908289176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":908289176},{"type":"v1","addr":"172.21.15.89:6805","nonce":908289176}]},"public_addr":"172.21.15.89:6801/908289176","cluster_addr":"172.21.15.89:6803/908289176","heartbeat_back_addr":"172.21.15.89:6807/908289176","heartbeat_front_addr":"172.21.15.89:6805/908289176","state":["exists","up"]},{"osd":1,"uuid":"671f6920-54e5-4839-ad7e-ca44ff87ceb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6801","nonce":2538027148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6803","nonce":2538027148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6807","nonce":2538027148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2538027148},{"type":"v1","addr":"172.21.15.120:6805","nonce":2538027148}]},"public_addr":"172.21.15.120:6801/2538027148","cluster_addr":"172.21.15.120:6803/2538027148","heartbeat_back_addr":"172.21.15.120:6807/2538027148","heartbeat_front_addr":"172.21.15.120:6805/2538027148","state":["exists","up"]},{"osd":2,"uuid":"e46b482a-7d0d-48a5-a625-9f8a31045bf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":32,"up_from":72,"up_thru":80,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6801","nonce":427257840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6803","nonce":427257840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6807","nonce":427257840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":427257840},{"type":"v1","addr":"172.21.15.172:6805","nonce":427257840}]},"public_addr":"172.21.15.172:6801/427257840","cluster_addr":"172.21.15.172:6803/427257840","heartbeat_back_addr":"172.21.15.172:6807/427257840","heartbeat_front_addr":"172.21.15.172:6805/427257840","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.056106+0000","dead_epoch":76},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.592376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T21:50:26.835978+0000","dead_epoch":32}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.1","mappings":[{"from":0,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.c","mappings":[{"from":0,"to":2}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T21:57:30.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T21:57:31.254 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T21:57:31.255 INFO:tasks.ceph.mds.a.smithi053.stderr: -2583> 2024-09-12T21:50:41.831+0000 7f32b80bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T21:57:31.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T21:57:31.282 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-12T21:57:32.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T21:57:33.486 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-12T21:57:33.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T21:57:34.488 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-12T21:57:34.505 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T21:57:34.505 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T21:57:34.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.516 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T21:57:34.516 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T21:57:34.516 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T21:57:34.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.543 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T21:57:34.543 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T21:57:34.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.599 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T21:57:34.600 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T21:57:34.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.633 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T21:57:34.634 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T21:57:34.634 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T21:57:34.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.664 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T21:57:34.664 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T21:57:34.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.731 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T21:57:34.731 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T21:57:34.732 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T21:57:34.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.785 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T21:57:34.785 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T21:57:34.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.839 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T21:57:34.840 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T21:57:34.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T21:57:34.894 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T21:57:34.894 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T21:57:34.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T21:57:34.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:57:34.975 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T21:57:35.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T21:57:35.091 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T21:57:35.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:57:35.215 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T21:57:35.333 INFO:tasks.ceph:Archiving mon data... 2024-09-12T21:57:35.334 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/data/mon.a.tgz 2024-09-12T21:57:35.334 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-12T21:57:35.354 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.hiduF1oJ0h 2024-09-12T21:57:35.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hiduF1oJ0h 2024-09-12T21:57:35.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.hiduF1oJ0h 2024-09-12T21:57:35.620 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.hiduF1oJ0h is 438KB 2024-09-12T21:57:35.690 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.hiduF1oJ0h 2024-09-12T21:57:35.706 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/data/mon.b.tgz 2024-09-12T21:57:35.707 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-12T21:57:35.761 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.gjQ8rJctiW 2024-09-12T21:57:35.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.gjQ8rJctiW 2024-09-12T21:57:35.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.gjQ8rJctiW 2024-09-12T21:57:36.041 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.gjQ8rJctiW is 602KB 2024-09-12T21:57:36.140 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.gjQ8rJctiW 2024-09-12T21:57:36.156 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/data/mon.c.tgz 2024-09-12T21:57:36.157 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-12T21:57:36.211 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.fIDgfCGOwm 2024-09-12T21:57:36.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fIDgfCGOwm 2024-09-12T21:57:36.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.fIDgfCGOwm 2024-09-12T21:57:36.488 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.fIDgfCGOwm is 602KB 2024-09-12T21:57:36.561 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.fIDgfCGOwm 2024-09-12T21:57:36.576 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T21:57:36.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T21:57:36.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T21:57:36.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T21:57:36.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T21:57:36.697 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T21:57:36.717 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T21:57:36.735 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T21:57:36.751 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T21:57:36.751 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T21:57:36.753 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi053/crash 2024-09-12T21:57:36.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T21:57:36.779 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi089/crash 2024-09-12T21:57:36.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T21:57:36.820 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi120/crash 2024-09-12T21:57:36.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T21:57:37.033 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi172/crash 2024-09-12T21:57:37.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T21:57:37.072 INFO:tasks.ceph:Compressing logs... 2024-09-12T21:57:37.072 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T21:57:37.075 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T21:57:37.078 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T21:57:37.080 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T21:57:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30245.log 2024-09-12T21:57:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-09-12T21:57:37.114 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T21:57:37.120 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T21:57:37.121 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.785.log 2024-09-12T21:57:37.121 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.785.log.gz 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790.log 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30378.log 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790.log.gz 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30378.log.gz 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30458.log 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-09-12T21:57:37.160 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.30458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30458.log.gz 2024-09-12T21:57:37.179 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30245.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31288.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36960.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33417.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31288.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37640.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36960.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35916.log 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33417.log.gz 2024-09-12T21:57:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37640.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35304.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35916.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38604.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30871.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35304.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38604.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36180.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30871.log.gz 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-09-12T21:57:37.181 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31753.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36180.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35257.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31753.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34341.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35257.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34212.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30530.log 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34341.log.gz 2024-09-12T21:57:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30437.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34212.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38833.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30530.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30437.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37934.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38833.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30349.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37934.log.gz 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30744.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-09-12T21:57:37.183 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30349.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30094.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30744.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36002.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33113.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30094.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30307.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36002.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33113.log.gz 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-09-12T21:57:37.184 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30307.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38396.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33948.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36399.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38396.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33948.log.gz 2024-09-12T21:57:37.185 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36399.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37892.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37976.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37892.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33238.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28773.log 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37976.log.gz 2024-09-12T21:57:37.186 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31163.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33238.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.28773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32757.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28773.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31961.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31163.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37826.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32757.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35655.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31961.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34998.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37826.log.gz 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-12T21:57:37.187 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35655.log.gz 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32003.log 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34998.log.gz 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34473.log 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31919.log 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32003.log.gz 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-09-12T21:57:37.188 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34473.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31919.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31627.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31627.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31249.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30702.log 2024-09-12T21:57:37.189 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37679.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31249.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38018.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30702.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37679.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38018.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36135.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5/var/log/ceph/ceph-client.admin.32285.log: --verbose -- /var/log/ceph/ceph-client.admin.30786.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36135.log.gz 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32610.log 2024-09-12T21:57:37.190 INFO:teuthology.orchestra.run.smithi053.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30786.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35961.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz -5 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38562.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32610.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38562.log: /var/log/ceph/ceph-client.admin.38228.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38562.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32461.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.32461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log 2024-09-12T21:57:37.191 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.32461.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37430.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31417.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32714.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31417.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34121.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32714.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34121.log.gz 2024-09-12T21:57:37.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37472.log: -- /var/log/ceph/ceph-client.admin.32370.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35477.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38688.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35477.log.gz 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32170.log 2024-09-12T21:57:37.193 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38688.log.gz 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38186.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32170.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32170.log.gz 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38186.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38186.log.gz 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38060.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30017.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-09-12T21:57:37.194 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38060.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30017.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31081.log 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31039.log 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30660.log 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31081.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31039.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37220.log 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30660.log.gz 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gzgzip 2024-09-12T21:57:37.195 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30488.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37220.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34911.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30488.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34911.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2024-09-12T21:57:37.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36222.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32893.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33553.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36222.log.gz 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32893.log.gz 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33553.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33553.log.gz --verbose 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: -- /var/log/ceph/ceph-client.admin.33816.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-09-12T21:57:37.197 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33816.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33993.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33348.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33993.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33348.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36918.log 2024-09-12T21:57:37.198 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33174.log 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36918.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33174.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.34646.log -- replaced with /var/log/ceph/ceph-client.admin.33174.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37680.log 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34646.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37680.log.gz 2024-09-12T21:57:37.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34035.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35217.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30913.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34035.log.gz 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35217.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35217.log.gz 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30913.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30913.log.gz -5 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30997.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31585.log 2024-09-12T21:57:37.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30997.log.gz 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33642.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31585.log.gz 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gzgzip 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33642.log.gz 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34605.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 2024-09-12T21:57:37.201 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34605.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31795.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33687.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.31795.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-09-12T21:57:37.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% 95.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33687.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37086.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31543.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31877.log: gzip -5 93.9% --verbose -- replaced with /var/log/ceph/ceph-mgr.y.log.gz -- 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.34711.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36573.log 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31543.log.gz 2024-09-12T21:57:37.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36573.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.36593.log -- replaced with /var/log/ceph/ceph-client.admin.36573.log.gz 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35829.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30150.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36593.log.gz 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35829.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35829.log.gz -5 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32413.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30150.log.gz 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2024-09-12T21:57:37.204 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32413.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37554.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31161.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32460.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37554.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31161.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32460.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-09-12T21:57:37.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29643.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36834.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29643.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32169.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33280.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32169.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32169.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33280.log.gz 2024-09-12T21:57:37.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 0.0% 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35783.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38790.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34866.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35783.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38790.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30572.log 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34866.log.gz 2024-09-12T21:57:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30572.log.gz 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31162.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38354.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31162.log.gz 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32171.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38144.log 2024-09-12T21:57:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38354.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32171.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29853.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38144.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29853.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29853.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33506.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr: -- /var/log/ceph/ceph-client.admin.37346.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33506.log.gz 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-09-12T21:57:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37346.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37346.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33175.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33175.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30618.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35523.log 0.0% 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30618.log.gz 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-09-12T21:57:37.210 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35523.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32673.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35085.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32673.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35043.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-09-12T21:57:37.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30955.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35043.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38480.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.30829.log -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31669.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30955.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36308.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30829.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30393.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31669.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32172.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36308.log.gz 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-09-12T21:57:37.212 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30393.log.gz 2024-09-12T21:57:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32172.log.gz 2024-09-12T21:57:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-09-12T21:57:37.232 INFO:teuthology.orchestra.run.smithi053.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T21:57:37.253 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T21:57:37.318 INFO:teuthology.orchestra.run.smithi053.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T21:57:37.426 INFO:teuthology.orchestra.run.smithi053.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T21:57:37.428 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-12T21:57:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m0.340s 2024-09-12T21:57:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m0.761s 2024-09-12T21:57:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.121s 2024-09-12T21:57:44.415 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T21:57:44.417 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-12T21:57:44.417 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m7.283s 2024-09-12T21:57:44.417 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m6.827s 2024-09-12T21:57:44.417 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.276s 2024-09-12T21:58:14.372 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T21:58:14.374 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-12T21:58:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m37.283s 2024-09-12T21:58:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m33.682s 2024-09-12T21:58:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m1.313s 2024-09-12T21:58:24.241 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.1.log: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T21:58:24.241 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-12T21:58:24.241 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m47.143s 2024-09-12T21:58:24.241 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m45.568s 2024-09-12T21:58:24.241 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m1.496s 2024-09-12T21:58:24.242 INFO:tasks.ceph:Archiving logs... 2024-09-12T21:58:24.242 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi053/log 2024-09-12T21:58:24.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T21:58:24.571 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi089/log 2024-09-12T21:58:24.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T21:58:29.951 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi120/log 2024-09-12T21:58:29.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T21:58:37.197 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi172/log 2024-09-12T21:58:37.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T21:58:38.306 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T21:58:38.315 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T21:58:38.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T21:58:38.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T21:58:38.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T21:58:38.323 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T21:58:38.428 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T21:58:38.437 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T21:58:38.437 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:58:38.440 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:58:38.442 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:58:38.445 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T21:58:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:58:38.456 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:58:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:58:38.460 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:58:38.460 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-12T21:58:38.460 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 -506us[ -488us] +/- 46ms 2024-09-12T21:58:38.461 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 +221us[ +221us] +/- 49ms 2024-09-12T21:58:38.461 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +504us[ +504us] +/- 63ms 2024-09-12T21:58:38.461 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:58:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:58:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-12T21:58:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 77 13 -544us[ -507us] +/- 47ms 2024-09-12T21:58:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 77 14 +205us[ +242us] +/- 49ms 2024-09-12T21:58:38.462 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 13 +472us[ +472us] +/- 63ms 2024-09-12T21:58:38.463 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:58:38.463 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T21:58:38.464 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:58:38.465 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-12T21:58:38.465 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -505us[ -497us] +/- 46ms 2024-09-12T21:58:38.465 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 +233us[ +241us] +/- 49ms 2024-09-12T21:58:38.465 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +503us[ +512us] +/- 63ms 2024-09-12T21:58:38.465 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:58:38.466 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T21:58:38.466 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T21:58:38.467 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 -524us[ -514us] +/- 46ms 2024-09-12T21:58:38.467 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +208us[ +208us] +/- 49ms 2024-09-12T21:58:38.467 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +472us[ +472us] +/- 62ms 2024-09-12T21:58:38.467 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T21:58:38.468 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T21:58:38.477 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T21:58:38.477 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T21:58:38.502 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T21:58:38.573 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T21:58:38.791 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T21:58:38.862 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T21:58:38.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:58:39.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:39.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:58:39.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:39.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:58:39.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:39.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T21:58:39.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:39.103 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T21:58:39.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T21:58:39.145 INFO:teuthology.task.internal:Duration was 849.687441 seconds 2024-09-12T21:58:39.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T21:58:39.187 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T21:58:39.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T21:58:39.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T21:58:39.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T21:58:39.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T21:58:39.235 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:58:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:58:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:58:39.257 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T21:58:39.651 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T21:58:39.652 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-12T21:58:39.652 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T21:58:39.678 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-12T21:58:39.678 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T21:58:39.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T21:58:39.709 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T21:58:39.750 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T21:58:39.751 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T21:58:39.781 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T21:58:39.781 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T21:58:39.784 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T21:58:39.787 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T21:58:39.793 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T21:58:39.850 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T21:58:39.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T21:58:39.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T21:58:39.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T21:58:39.862 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T21:58:39.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T21:58:39.978 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T21:58:39.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T21:58:40.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T21:58:40.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T21:58:40.059 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T21:58:40.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T21:58:40.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.107 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.125 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-12T21:58:40.127 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-12T21:58:40.163 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-12T21:58:40.174 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-12T21:58:40.202 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:40.218 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:40.235 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:40.249 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T21:58:40.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:58:40.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T21:58:40.275 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T21:58:40.276 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi053 2024-09-12T21:58:40.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T21:58:40.312 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi089 2024-09-12T21:58:40.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T21:58:40.346 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi120 2024-09-12T21:58:40.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T21:58:40.380 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902901/remote/smithi172 2024-09-12T21:58:40.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T21:58:40.411 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T21:58:40.411 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T21:58:40.413 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T21:58:40.416 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T21:58:40.420 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T21:58:40.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T21:58:40.473 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T21:58:40.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T21:58:40.504 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T21:58:40.504 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T21:58:40.507 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T21:58:40.509 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T21:58:40.511 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T21:58:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 21:58 /home/ubuntu/cephtest 2024-09-12T21:58:40.524 INFO:teuthology.orchestra.run.smithi089.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 21:58 /home/ubuntu/cephtest 2024-09-12T21:58:40.524 INFO:teuthology.orchestra.run.smithi120.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 21:58 /home/ubuntu/cephtest 2024-09-12T21:58:40.526 INFO:teuthology.orchestra.run.smithi172.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 21:58 /home/ubuntu/cephtest 2024-09-12T21:58:40.527 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T21:58:40.545 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T21:58:40.633 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 849.6874408721924 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T21:58:40.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T21:58:40.713 INFO:teuthology.run:pass